Jul 06 20:56:42.765144 ip-10-0-131-226 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 20:56:42.765157 ip-10-0-131-226 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 20:56:42.765164 ip-10-0-131-226 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 20:56:42.765430 ip-10-0-131-226 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 20:56:52.807049 ip-10-0-131-226 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 20:56:52.807070 ip-10-0-131-226 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d3dabf3f1c50487f81981933e65cd89c -- Jul 06 20:58:22.955372 ip-10-0-131-226 systemd[1]: Starting Kubernetes Kubelet... Jul 06 20:58:23.494824 ip-10-0-131-226 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:58:23.494824 ip-10-0-131-226 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 20:58:23.494824 ip-10-0-131-226 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:58:23.494824 ip-10-0-131-226 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 20:58:23.495464 ip-10-0-131-226 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:58:23.497266 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.497183 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 20:58:23.501840 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501822 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:58:23.501840 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501841 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501845 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501848 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501851 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501853 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501856 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501859 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501861 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501864 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501866 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501869 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501871 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501874 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501877 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501879 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501887 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501890 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501892 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501897 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501901 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:58:23.501914 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501903 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501906 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501909 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501912 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501914 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501917 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501921 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501924 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501926 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501929 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501932 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501934 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501937 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501939 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501941 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501944 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501946 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501948 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501951 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:58:23.502394 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501953 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501955 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501958 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501960 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501963 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501965 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501967 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501970 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501973 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501975 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501977 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501979 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501982 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501984 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501987 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501990 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501994 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.501998 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502000 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502003 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:58:23.502852 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502007 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502009 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502012 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502014 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502017 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502019 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502022 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502024 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502027 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502029 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502032 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502035 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502037 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502041 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502044 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502046 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502049 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502051 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502054 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:58:23.503353 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502056 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502058 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502061 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502075 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502078 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502081 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502083 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502086 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502090 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502093 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502096 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502098 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502101 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502104 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502106 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502109 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502111 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502114 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502116 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502119 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:58:23.503811 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502799 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502806 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502809 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502814 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502818 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502821 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502824 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502827 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502829 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502832 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502834 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502836 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502839 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502841 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502844 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502846 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502849 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502851 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502855 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:58:23.504305 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502858 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502863 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502865 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502868 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502871 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502873 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502876 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502878 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502881 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502883 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502886 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502888 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502891 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502893 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502896 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502898 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502901 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502903 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502905 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:58:23.504821 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502909 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502911 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502913 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502916 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502918 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502921 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502923 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502927 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502929 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502932 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502934 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502937 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502939 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502941 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502944 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502946 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502949 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502951 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502954 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502956 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:58:23.505301 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502959 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502963 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.502966 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503018 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503022 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503025 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503028 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503030 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503033 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503035 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503038 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503040 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503043 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503046 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503048 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503050 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503053 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503055 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503058 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:58:23.505788 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503060 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503078 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503081 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503084 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503087 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503093 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503095 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503098 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503101 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503103 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503106 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503108 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503111 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503114 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503116 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503119 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503121 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503124 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503126 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503129 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:58:23.506261 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503131 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503134 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503495 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503500 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503503 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503506 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503509 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503511 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503514 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503516 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503519 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503521 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503524 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503526 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503529 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503531 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503534 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503538 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503540 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503543 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:58:23.506738 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503545 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503548 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503550 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503553 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503556 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503558 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503560 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503563 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503566 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503568 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503571 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503573 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503578 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503582 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503585 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503588 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503590 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503593 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503596 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503598 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:58:23.507226 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503601 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503603 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503606 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503608 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503611 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503613 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503616 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503618 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503621 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503625 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503627 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503629 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503632 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503634 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503637 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503639 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503642 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503644 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503647 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503650 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:58:23.507704 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503652 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503655 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503658 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503660 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503662 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503665 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503667 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503670 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503672 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503674 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503677 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503679 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503682 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503685 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503687 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503690 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503694 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503697 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503700 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:58:23.508194 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503703 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503705 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503710 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503713 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503716 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503719 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503721 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503724 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503727 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503729 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503733 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503736 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503739 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503742 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503744 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503747 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503749 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503752 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503755 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:58:23.508666 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503757 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503760 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.503763 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503842 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503853 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503861 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503868 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503875 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503878 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503882 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503887 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503890 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503893 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503896 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503899 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503905 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503908 2564 flags.go:64] FLAG: --cgroup-root="" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503911 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503915 2564 flags.go:64] FLAG: --client-ca-file="" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503917 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503920 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503925 2564 flags.go:64] FLAG: --cluster-domain="" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503928 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503931 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 20:58:23.509184 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503934 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503937 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503941 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503943 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503946 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503949 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503952 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503955 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503958 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503961 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503963 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503967 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503970 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503973 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503976 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503978 2564 flags.go:64] FLAG: --enable-server="true" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503982 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503986 2564 flags.go:64] FLAG: --event-burst="100" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503989 2564 flags.go:64] FLAG: --event-qps="50" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503991 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503994 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.503996 2564 flags.go:64] FLAG: --eviction-hard="" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504000 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504005 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504008 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 20:58:23.509839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504010 2564 flags.go:64] FLAG: --eviction-soft="" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504013 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504016 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504019 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504021 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504024 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504027 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504030 2564 flags.go:64] FLAG: --feature-gates="" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504034 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504036 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504039 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504042 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504045 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504048 2564 flags.go:64] FLAG: --help="false" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504050 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-131-226.ec2.internal" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504053 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504056 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504058 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504074 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504078 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504081 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504084 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504087 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 20:58:23.510444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504090 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504093 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504096 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504099 2564 flags.go:64] FLAG: --kube-reserved="" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504101 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504104 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504107 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504112 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504115 2564 flags.go:64] FLAG: --lock-file="" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504118 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504120 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504123 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504128 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504131 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504134 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504136 2564 flags.go:64] FLAG: --logging-format="text" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504139 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504142 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504145 2564 flags.go:64] FLAG: --manifest-url="" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504147 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504152 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504154 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504158 2564 flags.go:64] FLAG: --max-pods="110" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504161 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504164 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 20:58:23.511015 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504166 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504169 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504172 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504175 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504178 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504185 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504188 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504191 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504194 2564 flags.go:64] FLAG: --pod-cidr="" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504197 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504203 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504206 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504209 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504212 2564 flags.go:64] FLAG: --port="10250" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504216 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504220 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-002241ba2aa5c3b95" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504223 2564 flags.go:64] FLAG: --qos-reserved="" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504226 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504229 2564 flags.go:64] FLAG: --register-node="true" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504231 2564 flags.go:64] FLAG: --register-with-taints="" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504235 2564 flags.go:64] FLAG: --registry-burst="10" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504237 2564 flags.go:64] FLAG: --registry-qps="5" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504240 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504243 2564 flags.go:64] FLAG: --reserved-memory="" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504246 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 20:58:23.511650 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504249 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504252 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504255 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504258 2564 flags.go:64] FLAG: --runonce="false" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504260 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504263 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504266 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504269 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504271 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504274 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504277 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504280 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504282 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504285 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504288 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504290 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504293 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504297 2564 flags.go:64] FLAG: --system-cgroups="" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504299 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504304 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504307 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504312 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504317 2564 flags.go:64] FLAG: --tls-min-version="" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504320 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504322 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 20:58:23.512275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504325 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504328 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504331 2564 flags.go:64] FLAG: --v="2" Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504334 2564 flags.go:64] FLAG: --version="false" Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504339 2564 flags.go:64] FLAG: --vmodule="" Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504347 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.504350 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504469 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504474 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504477 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504481 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504485 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504488 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504491 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504494 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504496 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504499 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504501 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504504 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504506 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504509 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:58:23.512909 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504512 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504514 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504516 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504519 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504522 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504524 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504527 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504530 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504536 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504539 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504542 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504544 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504547 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504550 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504553 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504556 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504558 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504561 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504563 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:58:23.513430 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504566 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504568 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504571 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504574 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504576 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504579 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504581 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504584 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504586 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504588 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504591 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504593 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504596 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504600 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504603 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504605 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504608 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504610 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504613 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:58:23.513883 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504616 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504618 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504622 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504625 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504627 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504629 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504632 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504634 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504637 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504639 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504642 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504644 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504647 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504649 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504651 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504654 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504656 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504658 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504661 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:58:23.514360 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504664 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504666 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504669 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504671 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504673 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504676 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504678 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504681 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504683 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504686 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504688 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504690 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504693 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504696 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504698 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504702 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504704 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504707 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504709 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504712 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:58:23.514815 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504714 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:58:23.515299 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504717 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:58:23.515299 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504719 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:58:23.515299 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504721 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:58:23.515299 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504724 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:58:23.515299 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504726 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:58:23.515299 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504729 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:58:23.515299 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.504731 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:58:23.515299 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.505671 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:58:23.515299 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.512980 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 20:58:23.515299 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.512999 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 20:58:23.515299 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.513991 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 20:58:23.515299 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.513998 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 20:58:23.515299 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514058 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:58:23.515299 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514079 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:58:23.515299 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514082 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514086 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514089 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514092 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514096 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514100 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514103 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514106 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514108 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514111 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514114 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514117 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514119 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514122 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514124 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514127 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514130 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514132 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514135 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:58:23.515658 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514137 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514140 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514142 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514145 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514147 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514150 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514152 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514155 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514159 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514161 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514164 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514166 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514168 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514171 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514174 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514177 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514179 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514181 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514184 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514186 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:58:23.516192 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514188 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514191 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514193 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514196 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514198 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514201 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514203 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514205 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514208 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514210 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514213 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514215 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514218 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514220 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514223 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514225 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514228 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514230 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514233 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514235 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:58:23.516679 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514238 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514242 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514246 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514248 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514251 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514253 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514256 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514259 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514261 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514264 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514266 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514269 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514271 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514274 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514276 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514278 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514281 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514283 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514286 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514289 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:58:23.517175 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514291 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:58:23.517654 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514293 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:58:23.517654 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514296 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:58:23.517654 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514298 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:58:23.517654 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514301 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:58:23.517654 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514303 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:58:23.517654 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514306 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:58:23.517654 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514309 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:58:23.517654 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514311 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:58:23.517654 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514315 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:58:23.517654 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514319 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:58:23.517654 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514322 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:58:23.517654 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514325 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:58:23.517654 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514328 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:58:23.517654 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514332 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:58:23.517654 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514335 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:58:23.517654 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514337 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:58:23.517654 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514340 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:58:23.518075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.514345 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:58:23.518075 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514486 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:58:23.518075 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514491 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:58:23.518075 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514494 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:58:23.518075 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514497 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:58:23.518075 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514500 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:58:23.518075 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514503 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:58:23.518075 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514506 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:58:23.518075 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514509 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:58:23.518075 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514512 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:58:23.518075 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514515 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:58:23.518075 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514517 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:58:23.518075 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514520 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:58:23.518075 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514523 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:58:23.518075 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514525 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514527 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514530 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514532 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514535 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514537 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514540 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514543 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514545 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514548 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514550 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514552 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514555 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514558 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514560 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514563 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514566 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514568 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514570 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514573 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:58:23.518442 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514576 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514580 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514584 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514588 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514591 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514593 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514596 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514599 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514601 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514604 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514607 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514609 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514612 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514614 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514617 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514619 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514622 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514624 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514627 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:58:23.518932 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514629 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514632 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514634 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514637 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514639 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514641 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514644 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514646 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514648 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514652 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514656 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514659 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514661 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514664 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514667 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514669 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514672 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514675 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514677 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:58:23.519412 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514680 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514682 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514684 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514687 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514689 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514691 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514693 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514696 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514698 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514700 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514703 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514706 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514708 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514710 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514713 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514715 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514718 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514720 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514722 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514725 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:58:23.519857 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514727 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:58:23.520354 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514729 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:58:23.520354 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514732 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:58:23.520354 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514734 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:58:23.520354 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514737 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:58:23.520354 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514739 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:58:23.520354 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514741 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:58:23.520354 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:23.514744 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:58:23.520354 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.514748 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:58:23.520354 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.514857 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 20:58:23.520354 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.516884 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 20:58:23.520354 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.518147 2564 server.go:1019] "Starting client certificate rotation" Jul 06 20:58:23.520354 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.518244 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:58:23.520354 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.518274 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:58:23.520788 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.520774 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:58:23.524241 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.524220 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:58:23.539421 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.539397 2564 log.go:25] "Validated CRI v1 runtime API" Jul 06 20:58:23.541585 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.541566 2564 log.go:25] "Validated CRI v1 image API" Jul 06 20:58:23.542407 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.542390 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 20:58:23.551296 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.551265 2564 fs.go:135] Filesystem UUIDs: map[0a93e017-7485-49a4-b777-167f0a8fce69:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a0a7c501-8d35-43e0-a4e2-5f123a5fd399:/dev/nvme0n1p4] Jul 06 20:58:23.551384 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.551294 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 20:58:23.556683 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.556564 2564 manager.go:216] Machine: {Timestamp:2026-07-06 20:58:23.555156431 +0000 UTC m=+0.442436787 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3163096 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f7e8ac98ca8849857351c7f0ddbe7 SystemUUID:ec2f7e8a-c98c-a884-9857-351c7f0ddbe7 BootID:d3dabf3f-1c50-487f-8198-1933e65cd89c Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:18:9a:e3:a5:df Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:18:9a:e3:a5:df Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:4c:dc:3d:dd:fe Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 20:58:23.556683 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.556682 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 20:58:23.556834 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.556794 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 20:58:23.562846 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.562829 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:58:23.564299 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.564275 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 20:58:23.564451 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.564303 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-226.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 20:58:23.565671 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.565659 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 20:58:23.565710 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.565674 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 20:58:23.565710 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.565681 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:58:23.565710 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.565697 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:58:23.567196 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.567186 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 20:58:23.570194 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.570183 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:58:23.570320 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.570310 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 20:58:23.570350 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.570342 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 06 20:58:23.570380 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.570356 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 20:58:23.570407 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.570380 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 20:58:23.570407 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.570394 2564 kubelet.go:398] "Adding apiserver pod source" Jul 06 20:58:23.570407 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.570406 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 20:58:23.570748 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.570736 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:58:23.570785 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.570755 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:58:23.574273 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.574256 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 20:58:23.575952 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.575935 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 20:58:23.576036 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.575974 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 20:58:23.577579 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.577565 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 20:58:23.577659 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.577584 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 20:58:23.577659 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.577593 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 20:58:23.577659 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.577601 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 20:58:23.577659 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.577616 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 20:58:23.577659 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.577625 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 20:58:23.577659 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.577639 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 20:58:23.577659 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.577648 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 20:58:23.577659 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.577658 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 20:58:23.577897 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.577668 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 20:58:23.577897 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.577688 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 20:58:23.577897 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.577698 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 20:58:23.579126 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.579114 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 20:58:23.579192 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.579129 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 20:58:23.582820 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.582797 2564 server.go:1268] "Started kubelet" Jul 06 20:58:23.583043 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.583011 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 20:58:23.583853 ip-10-0-131-226 systemd[1]: Started Kubernetes Kubelet. Jul 06 20:58:23.584004 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:23.583937 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-226.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 20:58:23.584166 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.584147 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-226.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 20:58:23.584536 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.584263 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 20:58:23.584536 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.584324 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 20:58:23.584902 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:23.584795 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 20:58:23.585458 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.585445 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 06 20:58:23.586393 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.586367 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 20:58:23.590036 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:23.590016 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 20:58:23.591219 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.591203 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 20:58:23.591219 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.591204 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 20:58:23.591415 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:23.591398 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 06 20:58:23.591844 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.591827 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 20:58:23.591844 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.591830 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 20:58:23.591971 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.591856 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 20:58:23.591971 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.591947 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 06 20:58:23.591971 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.591957 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 06 20:58:23.592119 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.592094 2564 factory.go:55] Registering systemd factory Jul 06 20:58:23.592119 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.592110 2564 factory.go:223] Registration of the systemd container factory successfully Jul 06 20:58:23.592393 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.592380 2564 factory.go:153] Registering CRI-O factory Jul 06 20:58:23.592474 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.592396 2564 factory.go:223] Registration of the crio container factory successfully Jul 06 20:58:23.592474 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.592453 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 20:58:23.592573 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.592477 2564 factory.go:103] Registering Raw factory Jul 06 20:58:23.592573 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.592493 2564 manager.go:1196] Started watching for new ooms in manager Jul 06 20:58:23.592852 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.592837 2564 manager.go:349] Starting recovery of all containers Jul 06 20:58:23.594153 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:23.594102 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-226.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 20:58:23.595600 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:23.594103 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-226.ec2.internal.18bfceef0d9abb32 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-226.ec2.internal,UID:ip-10-0-131-226.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-226.ec2.internal,},FirstTimestamp:2026-07-06 20:58:23.582755634 +0000 UTC m=+0.470035998,LastTimestamp:2026-07-06 20:58:23.582755634 +0000 UTC m=+0.470035998,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-226.ec2.internal,}" Jul 06 20:58:23.602309 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.602294 2564 manager.go:354] Recovery completed Jul 06 20:58:23.603495 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.603466 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rs75g" Jul 06 20:58:23.606332 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:23.606311 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 20:58:23.606636 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.606619 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:58:23.608493 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.608478 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:58:23.608577 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.608510 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:58:23.608577 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.608525 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:58:23.612784 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.612762 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 20:58:23.612784 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.612784 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 20:58:23.612906 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.612802 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:58:23.612906 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.612822 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:58:23.613911 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.613889 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rs75g" Jul 06 20:58:23.614095 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.614049 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:58:23.614156 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.614100 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:58:23.614156 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.614114 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:58:23.615755 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.615741 2564 policy_none.go:49] "None policy: Start" Jul 06 20:58:23.615755 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.615757 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 20:58:23.615885 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.615771 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 20:58:23.617122 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.617112 2564 policy_none.go:47] "Start" Jul 06 20:58:23.618569 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:23.618491 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-226.ec2.internal.18bfceef0f2374bc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-226.ec2.internal,UID:ip-10-0-131-226.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-226.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-226.ec2.internal,},FirstTimestamp:2026-07-06 20:58:23.608493244 +0000 UTC m=+0.495773612,LastTimestamp:2026-07-06 20:58:23.608493244 +0000 UTC m=+0.495773612,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-226.ec2.internal,}" Jul 06 20:58:23.650630 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.650612 2564 manager.go:337] "Starting Device Plugin manager" Jul 06 20:58:23.671402 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:23.650681 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 20:58:23.671402 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.650690 2564 server.go:87] "Starting device plugin registration server" Jul 06 20:58:23.671402 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.650901 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 20:58:23.671402 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.650910 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 20:58:23.671402 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.651027 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 20:58:23.671402 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.651184 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 20:58:23.671402 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.651197 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 20:58:23.671402 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:23.651595 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 20:58:23.671402 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:23.651635 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-226.ec2.internal\" not found" Jul 06 20:58:23.671402 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.662420 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 20:58:23.671402 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.663734 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 20:58:23.671402 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.663775 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 20:58:23.671402 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.663795 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 20:58:23.671402 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:23.663824 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 20:58:23.671402 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.665970 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:58:23.751905 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.751779 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:58:23.752798 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.752782 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:58:23.752899 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.752813 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:58:23.752899 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.752824 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:58:23.752899 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.752847 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-226.ec2.internal" Jul 06 20:58:23.762032 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.762017 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-226.ec2.internal" Jul 06 20:58:23.762096 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:23.762041 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-226.ec2.internal\": node \"ip-10-0-131-226.ec2.internal\" not found" Jul 06 20:58:23.763938 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.763922 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal"] Jul 06 20:58:23.763987 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.763978 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:58:23.764780 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.764764 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:58:23.764865 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.764791 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:58:23.764865 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.764801 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:58:23.766092 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.766080 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:58:23.766185 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.766169 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" Jul 06 20:58:23.766248 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.766210 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:58:23.766749 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.766735 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:58:23.766815 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.766756 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:58:23.766815 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.766764 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:58:23.766815 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.766766 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:58:23.766815 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.766786 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:58:23.766815 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.766800 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:58:23.768400 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.768385 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" Jul 06 20:58:23.768462 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.768429 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:58:23.769034 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.769017 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:58:23.769142 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.769049 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:58:23.769142 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.769060 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:58:23.791697 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:23.791682 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-226.ec2.internal\" not found" node="ip-10-0-131-226.ec2.internal" Jul 06 20:58:23.793636 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.793612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5f2626d80cf6adaad426dfc2322e4da8-config\") pod \"kube-apiserver-proxy-ip-10-0-131-226.ec2.internal\" (UID: \"5f2626d80cf6adaad426dfc2322e4da8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" Jul 06 20:58:23.793731 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.793651 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8aa7ee406116a1f7fce36ddc8789b8d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal\" (UID: \"8aa7ee406116a1f7fce36ddc8789b8d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" Jul 06 20:58:23.793731 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.793680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa7ee406116a1f7fce36ddc8789b8d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal\" (UID: \"8aa7ee406116a1f7fce36ddc8789b8d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" Jul 06 20:58:23.795994 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:23.795978 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-226.ec2.internal\" not found" node="ip-10-0-131-226.ec2.internal" Jul 06 20:58:23.803917 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:23.803899 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 06 20:58:23.894162 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.894131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5f2626d80cf6adaad426dfc2322e4da8-config\") pod \"kube-apiserver-proxy-ip-10-0-131-226.ec2.internal\" (UID: \"5f2626d80cf6adaad426dfc2322e4da8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" Jul 06 20:58:23.894274 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.894172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8aa7ee406116a1f7fce36ddc8789b8d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal\" (UID: \"8aa7ee406116a1f7fce36ddc8789b8d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" Jul 06 20:58:23.894274 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.894189 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa7ee406116a1f7fce36ddc8789b8d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal\" (UID: \"8aa7ee406116a1f7fce36ddc8789b8d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" Jul 06 20:58:23.894274 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.894229 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa7ee406116a1f7fce36ddc8789b8d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal\" (UID: \"8aa7ee406116a1f7fce36ddc8789b8d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" Jul 06 20:58:23.894274 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.894233 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8aa7ee406116a1f7fce36ddc8789b8d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal\" (UID: \"8aa7ee406116a1f7fce36ddc8789b8d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" Jul 06 20:58:23.894274 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:23.894233 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5f2626d80cf6adaad426dfc2322e4da8-config\") pod \"kube-apiserver-proxy-ip-10-0-131-226.ec2.internal\" (UID: \"5f2626d80cf6adaad426dfc2322e4da8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" Jul 06 20:58:23.904549 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:23.904527 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 06 20:58:24.005361 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:24.005304 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 06 20:58:24.096106 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:24.096045 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" Jul 06 20:58:24.099223 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:24.099207 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" Jul 06 20:58:24.106331 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:24.106316 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 06 20:58:24.206965 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:24.206918 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 06 20:58:24.307450 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:24.307389 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 06 20:58:24.408102 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:24.408038 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 06 20:58:24.466014 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:24.465988 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:58:24.508602 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:24.508575 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 06 20:58:24.517738 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:24.517720 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 20:58:24.517874 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:24.517852 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 20:58:24.517973 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:24.517888 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 20:58:24.600252 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:24.600177 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:58:24.609495 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:24.609473 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 06 20:58:24.619288 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:24.619259 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 20:53:24 +0000 UTC" deadline="2028-02-06 12:12:49.144018774 +0000 UTC" Jul 06 20:58:24.619288 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:24.619284 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13911h14m24.524737323s" Jul 06 20:58:24.709562 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:24.709526 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 06 20:58:24.783682 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:24.783644 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:58:24.785680 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:24.785658 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:58:24.785804 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:24.785698 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:58:24.785804 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:24.785714 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:58:24.806379 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:24.806346 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aa7ee406116a1f7fce36ddc8789b8d7.slice/crio-bd78322d8867d6d87b497c52ad629814cc14a3cd5f49420a5dc4b36ebb232c6b WatchSource:0}: Error finding container bd78322d8867d6d87b497c52ad629814cc14a3cd5f49420a5dc4b36ebb232c6b: Status 404 returned error can't find the container with id bd78322d8867d6d87b497c52ad629814cc14a3cd5f49420a5dc4b36ebb232c6b Jul 06 20:58:24.806793 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:24.806774 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2626d80cf6adaad426dfc2322e4da8.slice/crio-83ce764c2449b865cd6ee060c03d358610ac44945bccf211ed2290256e7acbda WatchSource:0}: Error finding container 83ce764c2449b865cd6ee060c03d358610ac44945bccf211ed2290256e7acbda: Status 404 returned error can't find the container with id 83ce764c2449b865cd6ee060c03d358610ac44945bccf211ed2290256e7acbda Jul 06 20:58:24.809619 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:24.809601 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 06 20:58:24.810856 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:24.810838 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:58:24.909942 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:24.909858 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 06 20:58:25.010333 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:25.010303 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-226.ec2.internal\" not found" Jul 06 20:58:25.071030 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:25.071002 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:58:25.091778 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:25.091759 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" Jul 06 20:58:25.107964 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:25.107942 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:58:25.109606 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:25.109591 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" Jul 06 20:58:25.119458 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:25.119436 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:58:26.929695 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.929659 2564 apiserver.go:52] "Watching apiserver" Jul 06 20:58:26.937159 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.937131 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 20:58:26.937680 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.937654 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-qkvhj","openshift-multus/network-metrics-daemon-mlbxf","openshift-network-diagnostics/network-check-target-dqlm8","kube-system/konnectivity-agent-6fb64","kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qq8j8","openshift-image-registry/node-ca-knjjg","openshift-network-operator/iptables-alerter-f8klt","openshift-ovn-kubernetes/ovnkube-node-mbknp","kube-system/global-pull-secret-syncer-f4zwn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl","openshift-dns/node-resolver-cf2gt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal","openshift-multus/multus-additional-cni-plugins-2hwpl"] Jul 06 20:58:26.939362 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.939336 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-knjjg" Jul 06 20:58:26.940640 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.940616 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f8klt" Jul 06 20:58:26.941746 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.941685 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:26.941834 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:26.941763 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqlm8" podUID="89ca3d0e-a5af-4f93-af7c-46b8413b9aa7" Jul 06 20:58:26.943315 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.943128 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 20:58:26.943402 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.943371 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kptx6\"" Jul 06 20:58:26.943662 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.943603 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 20:58:26.947157 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.947134 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 20:58:26.947395 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.947378 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6fb64" Jul 06 20:58:26.947706 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.947685 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:58:26.947921 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.947889 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qkvhj" Jul 06 20:58:26.947921 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.947920 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c7xhd\"" Jul 06 20:58:26.948068 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.948052 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 20:58:26.948246 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.948227 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:26.948721 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.948703 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 20:58:26.948797 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.948736 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.949374 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.949353 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:26.949972 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.949954 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 20:58:26.950111 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.950098 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 20:58:26.951181 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.951162 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:26.951265 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:26.951225 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlbxf" podUID="35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d" Jul 06 20:58:26.952570 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.952551 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:26.952656 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:26.952615 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f4zwn" podUID="af7599f6-9dd4-4114-9924-17189fb49188" Jul 06 20:58:26.954096 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.954072 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2ctjn\"" Jul 06 20:58:26.956646 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.956624 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 20:58:26.956964 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.956947 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 20:58:26.957215 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.957198 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-svhj9\"" Jul 06 20:58:26.957480 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.957464 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9gwdv\"" Jul 06 20:58:26.957725 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.957708 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-j9ztx\"" Jul 06 20:58:26.957999 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.957977 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 20:58:26.958376 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.958363 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f59z7\"" Jul 06 20:58:26.958636 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.958618 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:58:26.958712 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.958676 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 20:58:26.958898 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.958865 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 20:58:26.959024 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.958918 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 20:58:26.959110 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.959095 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:26.959110 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.959108 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 20:58:26.959259 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.959241 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 20:58:26.959314 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.959305 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 20:58:26.959585 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.959567 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 20:58:26.960168 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.959936 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 20:58:26.960168 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.959968 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 20:58:26.960378 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.960347 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cf2gt" Jul 06 20:58:26.960449 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.960401 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 20:58:26.960921 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.960352 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 20:58:26.961693 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.961646 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-kubernetes\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:26.961785 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.961701 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq7qd\" (UniqueName: \"kubernetes.io/projected/a933fdae-34bf-47b1-a811-908317f0df93-kube-api-access-cq7qd\") pod \"node-ca-knjjg\" (UID: \"a933fdae-34bf-47b1-a811-908317f0df93\") " pod="openshift-image-registry/node-ca-knjjg" Jul 06 20:58:26.961785 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.961731 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-run-ovn\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.961785 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.961762 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.961926 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.961793 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-cni-binary-copy\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:26.961926 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.961823 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a8decb1-c467-42ec-a869-211c576ae380-cni-binary-copy\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:26.961926 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.961855 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14dfea34-a9cf-4d9a-a693-240ffbadeff1-agent-certs\") pod \"konnectivity-agent-6fb64\" (UID: \"14dfea34-a9cf-4d9a-a693-240ffbadeff1\") " pod="kube-system/konnectivity-agent-6fb64" Jul 06 20:58:26.961926 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.961879 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-kubelet\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.962766 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.961911 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-var-lib-openvswitch\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.962766 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962413 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-multus-cni-dir\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:26.962766 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ltnb\" (UniqueName: \"kubernetes.io/projected/6a8decb1-c467-42ec-a869-211c576ae380-kube-api-access-6ltnb\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:26.962766 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962472 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-sys\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:26.962766 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962485 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 20:58:26.962766 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962533 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a933fdae-34bf-47b1-a811-908317f0df93-serviceca\") pod \"node-ca-knjjg\" (UID: \"a933fdae-34bf-47b1-a811-908317f0df93\") " pod="openshift-image-registry/node-ca-knjjg" Jul 06 20:58:26.962766 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962558 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/41b93806-bd40-4596-b076-ef109dd4e9a7-ovn-node-metrics-cert\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.962766 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962583 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/41b93806-bd40-4596-b076-ef109dd4e9a7-ovnkube-script-lib\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.962766 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962601 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 20:58:26.962766 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962604 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-host-var-lib-kubelet\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:26.962766 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962674 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-sysctl-d\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:26.962766 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962699 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-host-var-lib-cni-bin\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:26.962766 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962717 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-host-run-multus-certs\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:26.962766 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962756 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a933fdae-34bf-47b1-a811-908317f0df93-host\") pod \"node-ca-knjjg\" (UID: \"a933fdae-34bf-47b1-a811-908317f0df93\") " pod="openshift-image-registry/node-ca-knjjg" Jul 06 20:58:26.963421 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962776 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 20:58:26.963421 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962790 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-etc-openvswitch\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.963421 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962814 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-run-openvswitch\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.963421 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962847 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-system-cni-dir\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:26.963421 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962880 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-cnibin\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:26.963421 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962898 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-etc-kubernetes\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:26.963421 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962913 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-run-systemd\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.963421 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962934 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-log-socket\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.963421 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962954 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/41b93806-bd40-4596-b076-ef109dd4e9a7-ovnkube-config\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.963421 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962968 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-os-release\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:26.963421 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.962985 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:26.963421 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963022 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-host-run-k8s-cni-cncf-io\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:26.963421 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963054 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-host-var-lib-cni-multus\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:26.963421 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963082 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a8decb1-c467-42ec-a869-211c576ae380-multus-daemon-config\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:26.963421 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963106 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/41b93806-bd40-4596-b076-ef109dd4e9a7-env-overrides\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.963421 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963129 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-host-run-netns\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:26.963421 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963152 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-sysctl-conf\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:26.964075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963182 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-tuned\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:26.964075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963204 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6502f4dc-9d3e-438c-bfee-82b50649fe28-tmp\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:26.964075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963228 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swb7p\" (UniqueName: \"kubernetes.io/projected/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-kube-api-access-swb7p\") pod \"network-metrics-daemon-mlbxf\" (UID: \"35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d\") " pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:26.964075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963251 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-run-netns\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.964075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963271 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-host\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:26.964075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963294 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr8s2\" (UniqueName: \"kubernetes.io/projected/6502f4dc-9d3e-438c-bfee-82b50649fe28-kube-api-access-nr8s2\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:26.964075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963324 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs\") pod \"network-metrics-daemon-mlbxf\" (UID: \"35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d\") " pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:26.964075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963348 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-multus-socket-dir-parent\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:26.964075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963394 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-sysconfig\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:26.964075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963429 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-run\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:26.964075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963466 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-node-log\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.964075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963518 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-cni-netd\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.964075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963541 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-lib-modules\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:26.964075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963570 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26ppn\" (UniqueName: \"kubernetes.io/projected/a41b2821-807f-47c8-b65a-548a8c67c149-kube-api-access-26ppn\") pod \"iptables-alerter-f8klt\" (UID: \"a41b2821-807f-47c8-b65a-548a8c67c149\") " pod="openshift-network-operator/iptables-alerter-f8klt" Jul 06 20:58:26.964075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963585 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 20:58:26.964075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963596 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-system-cni-dir\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:26.964075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963619 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.964827 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963643 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a41b2821-807f-47c8-b65a-548a8c67c149-iptables-alerter-script\") pod \"iptables-alerter-f8klt\" (UID: \"a41b2821-807f-47c8-b65a-548a8c67c149\") " pod="openshift-network-operator/iptables-alerter-f8klt" Jul 06 20:58:26.964827 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963677 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-modprobe-d\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:26.964827 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963703 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14dfea34-a9cf-4d9a-a693-240ffbadeff1-konnectivity-ca\") pod \"konnectivity-agent-6fb64\" (UID: \"14dfea34-a9cf-4d9a-a693-240ffbadeff1\") " pod="kube-system/konnectivity-agent-6fb64" Jul 06 20:58:26.964827 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963725 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wq65\" (UniqueName: \"kubernetes.io/projected/41b93806-bd40-4596-b076-ef109dd4e9a7-kube-api-access-5wq65\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.964827 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963766 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28g5n\" (UniqueName: \"kubernetes.io/projected/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-kube-api-access-28g5n\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:26.964827 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963805 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-cnibin\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:26.964827 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963831 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 20:58:26.964827 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963842 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:26.964827 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963867 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-systemd\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:26.964827 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963898 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q99fj\"" Jul 06 20:58:26.964827 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-multus-conf-dir\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:26.964827 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963943 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtjng\" (UniqueName: \"kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng\") pod \"network-check-target-dqlm8\" (UID: \"89ca3d0e-a5af-4f93-af7c-46b8413b9aa7\") " pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:26.964827 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963969 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-cni-bin\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.964827 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.963992 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a41b2821-807f-47c8-b65a-548a8c67c149-host-slash\") pod \"iptables-alerter-f8klt\" (UID: \"a41b2821-807f-47c8-b65a-548a8c67c149\") " pod="openshift-network-operator/iptables-alerter-f8klt" Jul 06 20:58:26.964827 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.964005 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dcz7n\"" Jul 06 20:58:26.964827 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.964018 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-hostroot\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:26.964827 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.964060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-systemd-units\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.964827 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.964083 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:26.965745 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.964106 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-os-release\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:26.965745 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.964124 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-var-lib-kubelet\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:26.965745 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.964144 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-slash\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:26.965745 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.965470 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:58:26.984662 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.984635 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nvdz6" Jul 06 20:58:26.993018 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:26.992994 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nvdz6" Jul 06 20:58:27.027875 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.027827 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" event={"ID":"8aa7ee406116a1f7fce36ddc8789b8d7","Type":"ContainerStarted","Data":"bd78322d8867d6d87b497c52ad629814cc14a3cd5f49420a5dc4b36ebb232c6b"} Jul 06 20:58:27.029261 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.029235 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" event={"ID":"5f2626d80cf6adaad426dfc2322e4da8","Type":"ContainerStarted","Data":"83ce764c2449b865cd6ee060c03d358610ac44945bccf211ed2290256e7acbda"} Jul 06 20:58:27.051167 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.051138 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 20:58:27.065311 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26ppn\" (UniqueName: \"kubernetes.io/projected/a41b2821-807f-47c8-b65a-548a8c67c149-kube-api-access-26ppn\") pod \"iptables-alerter-f8klt\" (UID: \"a41b2821-807f-47c8-b65a-548a8c67c149\") " pod="openshift-network-operator/iptables-alerter-f8klt" Jul 06 20:58:27.065433 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065321 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-system-cni-dir\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.065433 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065340 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.065433 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065355 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a41b2821-807f-47c8-b65a-548a8c67c149-iptables-alerter-script\") pod \"iptables-alerter-f8klt\" (UID: \"a41b2821-807f-47c8-b65a-548a8c67c149\") " pod="openshift-network-operator/iptables-alerter-f8klt" Jul 06 20:58:27.065433 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065373 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-modprobe-d\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.065433 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14dfea34-a9cf-4d9a-a693-240ffbadeff1-konnectivity-ca\") pod \"konnectivity-agent-6fb64\" (UID: \"14dfea34-a9cf-4d9a-a693-240ffbadeff1\") " pod="kube-system/konnectivity-agent-6fb64" Jul 06 20:58:27.065433 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065422 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wq65\" (UniqueName: \"kubernetes.io/projected/41b93806-bd40-4596-b076-ef109dd4e9a7-kube-api-access-5wq65\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.065675 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065446 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28g5n\" (UniqueName: \"kubernetes.io/projected/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-kube-api-access-28g5n\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:27.065675 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-cnibin\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.065675 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065511 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/af7599f6-9dd4-4114-9924-17189fb49188-dbus\") pod \"global-pull-secret-syncer-f4zwn\" (UID: \"af7599f6-9dd4-4114-9924-17189fb49188\") " pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:27.065675 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:27.065675 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065560 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-systemd\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.065675 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065583 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-multus-conf-dir\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.065675 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065607 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtjng\" (UniqueName: \"kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng\") pod \"network-check-target-dqlm8\" (UID: \"89ca3d0e-a5af-4f93-af7c-46b8413b9aa7\") " pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:27.065675 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065626 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-cni-bin\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.065675 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065641 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a41b2821-807f-47c8-b65a-548a8c67c149-host-slash\") pod \"iptables-alerter-f8klt\" (UID: \"a41b2821-807f-47c8-b65a-548a8c67c149\") " pod="openshift-network-operator/iptables-alerter-f8klt" Jul 06 20:58:27.065675 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065654 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-hostroot\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.065675 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065670 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-systemd-units\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.066022 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065691 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:27.066022 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065744 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-os-release\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.066022 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-var-lib-kubelet\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.066022 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065793 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-slash\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.066022 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065808 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-kubernetes\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.066022 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret\") pod \"global-pull-secret-syncer-f4zwn\" (UID: \"af7599f6-9dd4-4114-9924-17189fb49188\") " pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:27.066022 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065872 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xk2t\" (UniqueName: \"kubernetes.io/projected/0baf1d79-4121-4204-930a-08a0ada71541-kube-api-access-2xk2t\") pod \"node-resolver-cf2gt\" (UID: \"0baf1d79-4121-4204-930a-08a0ada71541\") " pod="openshift-dns/node-resolver-cf2gt" Jul 06 20:58:27.066022 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/172acbde-98a9-4caa-84e8-1bdc4bd16242-etc-selinux\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.066022 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065901 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/172acbde-98a9-4caa-84e8-1bdc4bd16242-sys-fs\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.066022 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065916 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq7qd\" (UniqueName: \"kubernetes.io/projected/a933fdae-34bf-47b1-a811-908317f0df93-kube-api-access-cq7qd\") pod \"node-ca-knjjg\" (UID: \"a933fdae-34bf-47b1-a811-908317f0df93\") " pod="openshift-image-registry/node-ca-knjjg" Jul 06 20:58:27.066022 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065963 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-run-ovn\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.066022 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065981 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.066022 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.065997 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-cni-binary-copy\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:27.066022 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.066010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a8decb1-c467-42ec-a869-211c576ae380-cni-binary-copy\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.066483 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.066034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0baf1d79-4121-4204-930a-08a0ada71541-tmp-dir\") pod \"node-resolver-cf2gt\" (UID: \"0baf1d79-4121-4204-930a-08a0ada71541\") " pod="openshift-dns/node-resolver-cf2gt" Jul 06 20:58:27.066483 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.066053 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14dfea34-a9cf-4d9a-a693-240ffbadeff1-agent-certs\") pod \"konnectivity-agent-6fb64\" (UID: \"14dfea34-a9cf-4d9a-a693-240ffbadeff1\") " pod="kube-system/konnectivity-agent-6fb64" Jul 06 20:58:27.066483 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.066089 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-kubelet\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.066483 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.066191 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-var-lib-openvswitch\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.066646 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.066519 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-system-cni-dir\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.066646 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.066550 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-var-lib-openvswitch\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.066646 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.066568 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.066646 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.066608 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-multus-cni-dir\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.066916 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.066895 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a41b2821-807f-47c8-b65a-548a8c67c149-host-slash\") pod \"iptables-alerter-f8klt\" (UID: \"a41b2821-807f-47c8-b65a-548a8c67c149\") " pod="openshift-network-operator/iptables-alerter-f8klt" Jul 06 20:58:27.066986 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.066923 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-systemd-units\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.067045 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.066972 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-hostroot\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.067923 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.067362 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a41b2821-807f-47c8-b65a-548a8c67c149-iptables-alerter-script\") pod \"iptables-alerter-f8klt\" (UID: \"a41b2821-807f-47c8-b65a-548a8c67c149\") " pod="openshift-network-operator/iptables-alerter-f8klt" Jul 06 20:58:27.067923 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.067381 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-systemd\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.067923 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.067437 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-run-ovn\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.067923 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.067568 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-modprobe-d\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.067923 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.067578 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:27.067923 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.067654 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-cnibin\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.067923 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.067795 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:27.067923 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.067803 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-var-lib-kubelet\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.067923 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.067836 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ltnb\" (UniqueName: \"kubernetes.io/projected/6a8decb1-c467-42ec-a869-211c576ae380-kube-api-access-6ltnb\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.067923 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.067861 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-sys\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.067923 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.067853 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-kubelet\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.067923 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.067926 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-os-release\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.068531 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.067928 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-multus-cni-dir\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.068531 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.067978 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a933fdae-34bf-47b1-a811-908317f0df93-serviceca\") pod \"node-ca-knjjg\" (UID: \"a933fdae-34bf-47b1-a811-908317f0df93\") " pod="openshift-image-registry/node-ca-knjjg" Jul 06 20:58:27.068531 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068011 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/41b93806-bd40-4596-b076-ef109dd4e9a7-ovn-node-metrics-cert\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.068531 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068028 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.068531 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068033 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 20:58:27.068531 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068038 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/41b93806-bd40-4596-b076-ef109dd4e9a7-ovnkube-script-lib\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.068531 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-host-var-lib-kubelet\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.068531 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-sysctl-d\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.068531 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068255 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-host-var-lib-cni-bin\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.068531 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068282 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-host-run-multus-certs\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.068531 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a933fdae-34bf-47b1-a811-908317f0df93-host\") pod \"node-ca-knjjg\" (UID: \"a933fdae-34bf-47b1-a811-908317f0df93\") " pod="openshift-image-registry/node-ca-knjjg" Jul 06 20:58:27.068531 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068360 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-etc-openvswitch\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.068531 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068386 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-run-openvswitch\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.068531 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068437 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-system-cni-dir\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:27.068531 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068515 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-cnibin\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:27.069226 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068536 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a933fdae-34bf-47b1-a811-908317f0df93-serviceca\") pod \"node-ca-knjjg\" (UID: \"a933fdae-34bf-47b1-a811-908317f0df93\") " pod="openshift-image-registry/node-ca-knjjg" Jul 06 20:58:27.069226 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068604 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-kubernetes\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.069226 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068611 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-etc-kubernetes\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.069226 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068633 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-slash\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.069226 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068621 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-cni-binary-copy\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:27.069226 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-run-systemd\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.069226 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068660 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14dfea34-a9cf-4d9a-a693-240ffbadeff1-konnectivity-ca\") pod \"konnectivity-agent-6fb64\" (UID: \"14dfea34-a9cf-4d9a-a693-240ffbadeff1\") " pod="kube-system/konnectivity-agent-6fb64" Jul 06 20:58:27.069226 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068756 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-sys\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.069226 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068783 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-run-openvswitch\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.069226 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068831 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-log-socket\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.069226 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068849 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-sysctl-d\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.069226 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068884 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/41b93806-bd40-4596-b076-ef109dd4e9a7-ovnkube-config\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.069226 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068894 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-run-systemd\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.069226 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-os-release\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:27.069226 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068929 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-cnibin\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:27.069226 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.068985 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-multus-conf-dir\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.069226 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.069006 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-etc-openvswitch\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.069226 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.069010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:27.069909 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.069024 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-system-cni-dir\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:27.069909 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.069065 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-etc-kubernetes\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.069909 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.069069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-host-run-k8s-cni-cncf-io\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.070058 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.070033 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-host-var-lib-cni-multus\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.070544 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.070521 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:27.075193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.072934 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a8decb1-c467-42ec-a869-211c576ae380-cni-binary-copy\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.075193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.073034 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/41b93806-bd40-4596-b076-ef109dd4e9a7-ovnkube-config\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.075193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.073086 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a933fdae-34bf-47b1-a811-908317f0df93-host\") pod \"node-ca-knjjg\" (UID: \"a933fdae-34bf-47b1-a811-908317f0df93\") " pod="openshift-image-registry/node-ca-knjjg" Jul 06 20:58:27.075193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.073527 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14dfea34-a9cf-4d9a-a693-240ffbadeff1-agent-certs\") pod \"konnectivity-agent-6fb64\" (UID: \"14dfea34-a9cf-4d9a-a693-240ffbadeff1\") " pod="kube-system/konnectivity-agent-6fb64" Jul 06 20:58:27.075193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.073604 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a8decb1-c467-42ec-a869-211c576ae380-multus-daemon-config\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.075193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.073687 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/41b93806-bd40-4596-b076-ef109dd4e9a7-env-overrides\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.075193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.073762 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-host-run-netns\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.075193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.073792 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-sysctl-conf\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.075193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.073819 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-tuned\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.075193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.073844 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6502f4dc-9d3e-438c-bfee-82b50649fe28-tmp\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.075193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.073947 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swb7p\" (UniqueName: \"kubernetes.io/projected/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-kube-api-access-swb7p\") pod \"network-metrics-daemon-mlbxf\" (UID: \"35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d\") " pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:27.075193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.073980 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0baf1d79-4121-4204-930a-08a0ada71541-hosts-file\") pod \"node-resolver-cf2gt\" (UID: \"0baf1d79-4121-4204-930a-08a0ada71541\") " pod="openshift-dns/node-resolver-cf2gt" Jul 06 20:58:27.075193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.074012 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-run-netns\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.075193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.074061 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-host\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.075193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.074087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr8s2\" (UniqueName: \"kubernetes.io/projected/6502f4dc-9d3e-438c-bfee-82b50649fe28-kube-api-access-nr8s2\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.075193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.074116 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs\") pod \"network-metrics-daemon-mlbxf\" (UID: \"35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d\") " pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:27.075193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.074157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/172acbde-98a9-4caa-84e8-1bdc4bd16242-registration-dir\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.076004 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.074186 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/172acbde-98a9-4caa-84e8-1bdc4bd16242-device-dir\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.076004 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.074367 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfrcl\" (UniqueName: \"kubernetes.io/projected/172acbde-98a9-4caa-84e8-1bdc4bd16242-kube-api-access-sfrcl\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.076004 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.074401 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-multus-socket-dir-parent\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.076004 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.074440 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-sysconfig\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.076004 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.074469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-run\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.076004 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.074526 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/af7599f6-9dd4-4114-9924-17189fb49188-kubelet-config\") pod \"global-pull-secret-syncer-f4zwn\" (UID: \"af7599f6-9dd4-4114-9924-17189fb49188\") " pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:27.076004 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.074550 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/172acbde-98a9-4caa-84e8-1bdc4bd16242-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.076004 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.074590 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/172acbde-98a9-4caa-84e8-1bdc4bd16242-socket-dir\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.076004 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.074619 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-node-log\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.076004 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.074672 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-cni-netd\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.076004 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.074716 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-lib-modules\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.076004 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.074887 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-lib-modules\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.076004 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.075620 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-os-release\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:27.076591 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.076154 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/41b93806-bd40-4596-b076-ef109dd4e9a7-env-overrides\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.076591 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.076256 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-cni-bin\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.076591 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.076302 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-log-socket\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.076591 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.076354 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-host-var-lib-kubelet\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.076591 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.076407 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-host-run-k8s-cni-cncf-io\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.076591 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.076456 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-host-var-lib-cni-multus\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.077002 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.076981 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a8decb1-c467-42ec-a869-211c576ae380-multus-daemon-config\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.077064 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.077048 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-host-run-netns\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.077187 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.077154 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-sysctl-conf\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.077249 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.077233 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-multus-socket-dir-parent\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.077302 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.077294 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-sysconfig\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.077354 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.077344 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-run\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.077429 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.077404 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6502f4dc-9d3e-438c-bfee-82b50649fe28-host\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.077549 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.077437 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-node-log\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.077549 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.077471 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-host-var-lib-cni-bin\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.077549 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.077458 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6502f4dc-9d3e-438c-bfee-82b50649fe28-tmp\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.077706 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.077571 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-cni-netd\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.077852 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:27.077830 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:58:27.077910 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:27.077859 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:58:27.077910 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:27.077873 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jtjng for pod openshift-network-diagnostics/network-check-target-dqlm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:27.077910 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.077891 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a8decb1-c467-42ec-a869-211c576ae380-host-run-multus-certs\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.078067 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:27.077964 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng podName:89ca3d0e-a5af-4f93-af7c-46b8413b9aa7 nodeName:}" failed. No retries permitted until 2026-07-06 20:58:27.577930623 +0000 UTC m=+3.106778419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jtjng" (UniqueName: "kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng") pod "network-check-target-dqlm8" (UID: "89ca3d0e-a5af-4f93-af7c-46b8413b9aa7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:27.078067 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.077968 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41b93806-bd40-4596-b076-ef109dd4e9a7-host-run-netns\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.078174 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:27.078074 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:27.078268 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:27.078253 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs podName:35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d nodeName:}" failed. No retries permitted until 2026-07-06 20:58:27.578236653 +0000 UTC m=+3.107084455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs") pod "network-metrics-daemon-mlbxf" (UID: "35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:27.079037 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.078517 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/41b93806-bd40-4596-b076-ef109dd4e9a7-ovnkube-script-lib\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.079594 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.079295 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/41b93806-bd40-4596-b076-ef109dd4e9a7-ovn-node-metrics-cert\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.082419 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.082298 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6502f4dc-9d3e-438c-bfee-82b50649fe28-etc-tuned\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.082828 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.082784 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq7qd\" (UniqueName: \"kubernetes.io/projected/a933fdae-34bf-47b1-a811-908317f0df93-kube-api-access-cq7qd\") pod \"node-ca-knjjg\" (UID: \"a933fdae-34bf-47b1-a811-908317f0df93\") " pod="openshift-image-registry/node-ca-knjjg" Jul 06 20:58:27.084125 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.084099 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26ppn\" (UniqueName: \"kubernetes.io/projected/a41b2821-807f-47c8-b65a-548a8c67c149-kube-api-access-26ppn\") pod \"iptables-alerter-f8klt\" (UID: \"a41b2821-807f-47c8-b65a-548a8c67c149\") " pod="openshift-network-operator/iptables-alerter-f8klt" Jul 06 20:58:27.084216 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.084139 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wq65\" (UniqueName: \"kubernetes.io/projected/41b93806-bd40-4596-b076-ef109dd4e9a7-kube-api-access-5wq65\") pod \"ovnkube-node-mbknp\" (UID: \"41b93806-bd40-4596-b076-ef109dd4e9a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.087115 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.087052 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28g5n\" (UniqueName: \"kubernetes.io/projected/ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d-kube-api-access-28g5n\") pod \"multus-additional-cni-plugins-2hwpl\" (UID: \"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d\") " pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:27.088554 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.088481 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ltnb\" (UniqueName: \"kubernetes.io/projected/6a8decb1-c467-42ec-a869-211c576ae380-kube-api-access-6ltnb\") pod \"multus-qkvhj\" (UID: \"6a8decb1-c467-42ec-a869-211c576ae380\") " pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.091351 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.091296 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr8s2\" (UniqueName: \"kubernetes.io/projected/6502f4dc-9d3e-438c-bfee-82b50649fe28-kube-api-access-nr8s2\") pod \"tuned-qq8j8\" (UID: \"6502f4dc-9d3e-438c-bfee-82b50649fe28\") " pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.093673 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.093630 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swb7p\" (UniqueName: \"kubernetes.io/projected/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-kube-api-access-swb7p\") pod \"network-metrics-daemon-mlbxf\" (UID: \"35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d\") " pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:27.176930 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.175980 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0baf1d79-4121-4204-930a-08a0ada71541-hosts-file\") pod \"node-resolver-cf2gt\" (UID: \"0baf1d79-4121-4204-930a-08a0ada71541\") " pod="openshift-dns/node-resolver-cf2gt" Jul 06 20:58:27.176930 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176041 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/172acbde-98a9-4caa-84e8-1bdc4bd16242-registration-dir\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.176930 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176066 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/172acbde-98a9-4caa-84e8-1bdc4bd16242-device-dir\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.176930 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176078 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0baf1d79-4121-4204-930a-08a0ada71541-hosts-file\") pod \"node-resolver-cf2gt\" (UID: \"0baf1d79-4121-4204-930a-08a0ada71541\") " pod="openshift-dns/node-resolver-cf2gt" Jul 06 20:58:27.176930 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176089 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfrcl\" (UniqueName: \"kubernetes.io/projected/172acbde-98a9-4caa-84e8-1bdc4bd16242-kube-api-access-sfrcl\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.176930 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/af7599f6-9dd4-4114-9924-17189fb49188-kubelet-config\") pod \"global-pull-secret-syncer-f4zwn\" (UID: \"af7599f6-9dd4-4114-9924-17189fb49188\") " pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:27.176930 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176149 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/172acbde-98a9-4caa-84e8-1bdc4bd16242-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.176930 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/172acbde-98a9-4caa-84e8-1bdc4bd16242-socket-dir\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.176930 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/af7599f6-9dd4-4114-9924-17189fb49188-dbus\") pod \"global-pull-secret-syncer-f4zwn\" (UID: \"af7599f6-9dd4-4114-9924-17189fb49188\") " pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:27.176930 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176248 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret\") pod \"global-pull-secret-syncer-f4zwn\" (UID: \"af7599f6-9dd4-4114-9924-17189fb49188\") " pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:27.176930 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176271 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xk2t\" (UniqueName: \"kubernetes.io/projected/0baf1d79-4121-4204-930a-08a0ada71541-kube-api-access-2xk2t\") pod \"node-resolver-cf2gt\" (UID: \"0baf1d79-4121-4204-930a-08a0ada71541\") " pod="openshift-dns/node-resolver-cf2gt" Jul 06 20:58:27.176930 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176327 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/172acbde-98a9-4caa-84e8-1bdc4bd16242-etc-selinux\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.176930 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176347 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/172acbde-98a9-4caa-84e8-1bdc4bd16242-registration-dir\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.176930 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176354 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/172acbde-98a9-4caa-84e8-1bdc4bd16242-sys-fs\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.176930 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0baf1d79-4121-4204-930a-08a0ada71541-tmp-dir\") pod \"node-resolver-cf2gt\" (UID: \"0baf1d79-4121-4204-930a-08a0ada71541\") " pod="openshift-dns/node-resolver-cf2gt" Jul 06 20:58:27.176930 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176397 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/172acbde-98a9-4caa-84e8-1bdc4bd16242-device-dir\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.176930 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176464 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/172acbde-98a9-4caa-84e8-1bdc4bd16242-sys-fs\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.177931 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:27.176527 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:27.177931 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176532 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/172acbde-98a9-4caa-84e8-1bdc4bd16242-etc-selinux\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.177931 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176578 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/172acbde-98a9-4caa-84e8-1bdc4bd16242-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.177931 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:27.176606 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret podName:af7599f6-9dd4-4114-9924-17189fb49188 nodeName:}" failed. No retries permitted until 2026-07-06 20:58:27.676588281 +0000 UTC m=+3.205436059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret") pod "global-pull-secret-syncer-f4zwn" (UID: "af7599f6-9dd4-4114-9924-17189fb49188") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:27.177931 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176835 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/172acbde-98a9-4caa-84e8-1bdc4bd16242-socket-dir\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.177931 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.176885 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0baf1d79-4121-4204-930a-08a0ada71541-tmp-dir\") pod \"node-resolver-cf2gt\" (UID: \"0baf1d79-4121-4204-930a-08a0ada71541\") " pod="openshift-dns/node-resolver-cf2gt" Jul 06 20:58:27.177931 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.177049 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/af7599f6-9dd4-4114-9924-17189fb49188-kubelet-config\") pod \"global-pull-secret-syncer-f4zwn\" (UID: \"af7599f6-9dd4-4114-9924-17189fb49188\") " pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:27.177931 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.177132 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/af7599f6-9dd4-4114-9924-17189fb49188-dbus\") pod \"global-pull-secret-syncer-f4zwn\" (UID: \"af7599f6-9dd4-4114-9924-17189fb49188\") " pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:27.188457 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.188388 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xk2t\" (UniqueName: \"kubernetes.io/projected/0baf1d79-4121-4204-930a-08a0ada71541-kube-api-access-2xk2t\") pod \"node-resolver-cf2gt\" (UID: \"0baf1d79-4121-4204-930a-08a0ada71541\") " pod="openshift-dns/node-resolver-cf2gt" Jul 06 20:58:27.190822 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.190796 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfrcl\" (UniqueName: \"kubernetes.io/projected/172acbde-98a9-4caa-84e8-1bdc4bd16242-kube-api-access-sfrcl\") pod \"aws-ebs-csi-driver-node-b2hzl\" (UID: \"172acbde-98a9-4caa-84e8-1bdc4bd16242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.263886 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.263846 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-knjjg" Jul 06 20:58:27.271909 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.271884 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f8klt" Jul 06 20:58:27.273760 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:27.273667 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda933fdae_34bf_47b1_a811_908317f0df93.slice/crio-0e8204cdcd8c43bf5379ddbcd6949421061effbdc23632b3a875013d6ae9136e WatchSource:0}: Error finding container 0e8204cdcd8c43bf5379ddbcd6949421061effbdc23632b3a875013d6ae9136e: Status 404 returned error can't find the container with id 0e8204cdcd8c43bf5379ddbcd6949421061effbdc23632b3a875013d6ae9136e Jul 06 20:58:27.281217 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.281193 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6fb64" Jul 06 20:58:27.286817 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.286799 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qkvhj" Jul 06 20:58:27.293755 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.293732 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" Jul 06 20:58:27.303247 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.303070 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:27.311756 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.311734 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2hwpl" Jul 06 20:58:27.322680 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.322661 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" Jul 06 20:58:27.327378 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.327361 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cf2gt" Jul 06 20:58:27.370908 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.370879 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:58:27.580282 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.580250 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs\") pod \"network-metrics-daemon-mlbxf\" (UID: \"35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d\") " pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:27.580468 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.580300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtjng\" (UniqueName: \"kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng\") pod \"network-check-target-dqlm8\" (UID: \"89ca3d0e-a5af-4f93-af7c-46b8413b9aa7\") " pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:27.580468 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:27.580414 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:27.580468 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:27.580445 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:58:27.580468 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:27.580458 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:58:27.580468 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:27.580470 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jtjng for pod openshift-network-diagnostics/network-check-target-dqlm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:27.580762 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:27.580485 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs podName:35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d nodeName:}" failed. No retries permitted until 2026-07-06 20:58:28.580465845 +0000 UTC m=+4.109313645 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs") pod "network-metrics-daemon-mlbxf" (UID: "35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:27.580762 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:27.580522 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng podName:89ca3d0e-a5af-4f93-af7c-46b8413b9aa7 nodeName:}" failed. No retries permitted until 2026-07-06 20:58:28.580492414 +0000 UTC m=+4.109340209 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jtjng" (UniqueName: "kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng") pod "network-check-target-dqlm8" (UID: "89ca3d0e-a5af-4f93-af7c-46b8413b9aa7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:27.680829 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.680800 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret\") pod \"global-pull-secret-syncer-f4zwn\" (UID: \"af7599f6-9dd4-4114-9924-17189fb49188\") " pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:27.680979 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:27.680913 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:27.680979 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:27.680966 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret podName:af7599f6-9dd4-4114-9924-17189fb49188 nodeName:}" failed. No retries permitted until 2026-07-06 20:58:28.680953633 +0000 UTC m=+4.209801409 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret") pod "global-pull-secret-syncer-f4zwn" (UID: "af7599f6-9dd4-4114-9924-17189fb49188") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:27.995275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.995146 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:53:26 +0000 UTC" deadline="2027-12-15 05:06:10.826478616 +0000 UTC" Jul 06 20:58:27.995275 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:27.995180 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12632h7m42.831302915s" Jul 06 20:58:28.031886 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:28.031856 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-knjjg" event={"ID":"a933fdae-34bf-47b1-a811-908317f0df93","Type":"ContainerStarted","Data":"0e8204cdcd8c43bf5379ddbcd6949421061effbdc23632b3a875013d6ae9136e"} Jul 06 20:58:28.088974 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:28.088938 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:58:28.305227 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:28.305026 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0baf1d79_4121_4204_930a_08a0ada71541.slice/crio-787af7a8ae905e90d570c1fafcdfe9f777d7fe2373e552cf68f14704b95ab298 WatchSource:0}: Error finding container 787af7a8ae905e90d570c1fafcdfe9f777d7fe2373e552cf68f14704b95ab298: Status 404 returned error can't find the container with id 787af7a8ae905e90d570c1fafcdfe9f777d7fe2373e552cf68f14704b95ab298 Jul 06 20:58:28.306868 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:28.306843 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b93806_bd40_4596_b076_ef109dd4e9a7.slice/crio-608ad07006e6b34bd6780861fbac6b2450a02f438e0d952339af5cb5028b01f2 WatchSource:0}: Error finding container 608ad07006e6b34bd6780861fbac6b2450a02f438e0d952339af5cb5028b01f2: Status 404 returned error can't find the container with id 608ad07006e6b34bd6780861fbac6b2450a02f438e0d952339af5cb5028b01f2 Jul 06 20:58:28.312797 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:28.312774 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14dfea34_a9cf_4d9a_a693_240ffbadeff1.slice/crio-fe90e0603a909b7b4eff046758938e48f99ff6a58bcf166e8e3bca7fbb221dc1 WatchSource:0}: Error finding container fe90e0603a909b7b4eff046758938e48f99ff6a58bcf166e8e3bca7fbb221dc1: Status 404 returned error can't find the container with id fe90e0603a909b7b4eff046758938e48f99ff6a58bcf166e8e3bca7fbb221dc1 Jul 06 20:58:28.314040 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:28.314018 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a8decb1_c467_42ec_a869_211c576ae380.slice/crio-6c2d5728dd81e4bbdfe730f05de147d85a9364d684f6eca35c339c48be230a0f WatchSource:0}: Error finding container 6c2d5728dd81e4bbdfe730f05de147d85a9364d684f6eca35c339c48be230a0f: Status 404 returned error can't find the container with id 6c2d5728dd81e4bbdfe730f05de147d85a9364d684f6eca35c339c48be230a0f Jul 06 20:58:28.319600 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:28.319577 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbd164e_7a8c_4bfb_92e0_42b2012f5a5d.slice/crio-4423607f3f34ada79734494fde618cd38b1ce0df64110bf0abc2fcde71210d14 WatchSource:0}: Error finding container 4423607f3f34ada79734494fde618cd38b1ce0df64110bf0abc2fcde71210d14: Status 404 returned error can't find the container with id 4423607f3f34ada79734494fde618cd38b1ce0df64110bf0abc2fcde71210d14 Jul 06 20:58:28.320774 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:28.320752 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6502f4dc_9d3e_438c_bfee_82b50649fe28.slice/crio-75b89b8c52b3c23f7420e3c33a64d80b41fee2dd9b8ac906349c2e01f8af6727 WatchSource:0}: Error finding container 75b89b8c52b3c23f7420e3c33a64d80b41fee2dd9b8ac906349c2e01f8af6727: Status 404 returned error can't find the container with id 75b89b8c52b3c23f7420e3c33a64d80b41fee2dd9b8ac906349c2e01f8af6727 Jul 06 20:58:28.322896 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:28.322468 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod172acbde_98a9_4caa_84e8_1bdc4bd16242.slice/crio-8c34783642eaaf34d9c143e7434331578b9c1c9e5b618e6e32b7f3a55f8fcb05 WatchSource:0}: Error finding container 8c34783642eaaf34d9c143e7434331578b9c1c9e5b618e6e32b7f3a55f8fcb05: Status 404 returned error can't find the container with id 8c34783642eaaf34d9c143e7434331578b9c1c9e5b618e6e32b7f3a55f8fcb05 Jul 06 20:58:28.324674 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:58:28.324629 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda41b2821_807f_47c8_b65a_548a8c67c149.slice/crio-eaaad5379f757108a244d0c68f307a070ebd86528d8c68462a2e709bcab90baa WatchSource:0}: Error finding container eaaad5379f757108a244d0c68f307a070ebd86528d8c68462a2e709bcab90baa: Status 404 returned error can't find the container with id eaaad5379f757108a244d0c68f307a070ebd86528d8c68462a2e709bcab90baa Jul 06 20:58:28.588341 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:28.588313 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs\") pod \"network-metrics-daemon-mlbxf\" (UID: \"35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d\") " pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:28.588543 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:28.588373 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtjng\" (UniqueName: \"kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng\") pod \"network-check-target-dqlm8\" (UID: \"89ca3d0e-a5af-4f93-af7c-46b8413b9aa7\") " pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:28.588614 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:28.588572 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:58:28.588614 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:28.588595 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:58:28.588614 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:28.588609 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jtjng for pod openshift-network-diagnostics/network-check-target-dqlm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:28.588721 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:28.588657 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng podName:89ca3d0e-a5af-4f93-af7c-46b8413b9aa7 nodeName:}" failed. No retries permitted until 2026-07-06 20:58:30.588642253 +0000 UTC m=+6.117490030 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jtjng" (UniqueName: "kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng") pod "network-check-target-dqlm8" (UID: "89ca3d0e-a5af-4f93-af7c-46b8413b9aa7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:28.588924 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:28.588901 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:28.589012 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:28.588959 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs podName:35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d nodeName:}" failed. No retries permitted until 2026-07-06 20:58:30.588945451 +0000 UTC m=+6.117793232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs") pod "network-metrics-daemon-mlbxf" (UID: "35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:28.689548 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:28.689516 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret\") pod \"global-pull-secret-syncer-f4zwn\" (UID: \"af7599f6-9dd4-4114-9924-17189fb49188\") " pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:28.689716 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:28.689614 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:28.689716 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:28.689679 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret podName:af7599f6-9dd4-4114-9924-17189fb49188 nodeName:}" failed. No retries permitted until 2026-07-06 20:58:30.689665181 +0000 UTC m=+6.218512957 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret") pod "global-pull-secret-syncer-f4zwn" (UID: "af7599f6-9dd4-4114-9924-17189fb49188") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:28.996038 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:28.995929 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:53:26 +0000 UTC" deadline="2028-04-12 12:28:07.612059224 +0000 UTC" Jul 06 20:58:28.996038 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:28.995989 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15495h29m38.616075422s" Jul 06 20:58:29.025667 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:29.024871 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:29.025667 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:29.025007 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlbxf" podUID="35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d" Jul 06 20:58:29.025667 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:29.025376 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:29.025667 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:29.025468 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f4zwn" podUID="af7599f6-9dd4-4114-9924-17189fb49188" Jul 06 20:58:29.025667 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:29.025551 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:29.025667 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:29.025620 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqlm8" podUID="89ca3d0e-a5af-4f93-af7c-46b8413b9aa7" Jul 06 20:58:29.040660 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:29.040625 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" event={"ID":"172acbde-98a9-4caa-84e8-1bdc4bd16242","Type":"ContainerStarted","Data":"8c34783642eaaf34d9c143e7434331578b9c1c9e5b618e6e32b7f3a55f8fcb05"} Jul 06 20:58:29.043450 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:29.043406 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f8klt" event={"ID":"a41b2821-807f-47c8-b65a-548a8c67c149","Type":"ContainerStarted","Data":"eaaad5379f757108a244d0c68f307a070ebd86528d8c68462a2e709bcab90baa"} Jul 06 20:58:29.051359 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:29.051269 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" event={"ID":"41b93806-bd40-4596-b076-ef109dd4e9a7","Type":"ContainerStarted","Data":"608ad07006e6b34bd6780861fbac6b2450a02f438e0d952339af5cb5028b01f2"} Jul 06 20:58:29.056418 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:29.056350 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cf2gt" event={"ID":"0baf1d79-4121-4204-930a-08a0ada71541","Type":"ContainerStarted","Data":"787af7a8ae905e90d570c1fafcdfe9f777d7fe2373e552cf68f14704b95ab298"} Jul 06 20:58:29.061908 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:29.061865 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" event={"ID":"5f2626d80cf6adaad426dfc2322e4da8","Type":"ContainerStarted","Data":"483fc91deb0a30f93a4d9aa1ff17360137a82b90fd268fc402465057880ca383"} Jul 06 20:58:29.071937 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:29.071909 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qkvhj" event={"ID":"6a8decb1-c467-42ec-a869-211c576ae380","Type":"ContainerStarted","Data":"6c2d5728dd81e4bbdfe730f05de147d85a9364d684f6eca35c339c48be230a0f"} Jul 06 20:58:29.084924 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:29.084843 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" event={"ID":"6502f4dc-9d3e-438c-bfee-82b50649fe28","Type":"ContainerStarted","Data":"75b89b8c52b3c23f7420e3c33a64d80b41fee2dd9b8ac906349c2e01f8af6727"} Jul 06 20:58:29.088197 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:29.088095 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hwpl" event={"ID":"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d","Type":"ContainerStarted","Data":"4423607f3f34ada79734494fde618cd38b1ce0df64110bf0abc2fcde71210d14"} Jul 06 20:58:29.091134 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:29.090957 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6fb64" event={"ID":"14dfea34-a9cf-4d9a-a693-240ffbadeff1","Type":"ContainerStarted","Data":"fe90e0603a909b7b4eff046758938e48f99ff6a58bcf166e8e3bca7fbb221dc1"} Jul 06 20:58:29.096205 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:29.096081 2564 generic.go:356] "Generic (PLEG): container finished" podID="8aa7ee406116a1f7fce36ddc8789b8d7" containerID="a692b85b364c2be3027e252920f3dcc440848c6ed72da58c2bac4cbeaa24d396" exitCode=0 Jul 06 20:58:29.096205 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:29.096136 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" event={"ID":"8aa7ee406116a1f7fce36ddc8789b8d7","Type":"ContainerDied","Data":"a692b85b364c2be3027e252920f3dcc440848c6ed72da58c2bac4cbeaa24d396"} Jul 06 20:58:29.117710 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:29.117651 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-226.ec2.internal" podStartSLOduration=3.117632684 podStartE2EDuration="3.117632684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:58:29.083167978 +0000 UTC m=+4.612015775" watchObservedRunningTime="2026-07-06 20:58:29.117632684 +0000 UTC m=+4.646480678" Jul 06 20:58:30.606091 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:30.605330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs\") pod \"network-metrics-daemon-mlbxf\" (UID: \"35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d\") " pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:30.606091 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:30.605384 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtjng\" (UniqueName: \"kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng\") pod \"network-check-target-dqlm8\" (UID: \"89ca3d0e-a5af-4f93-af7c-46b8413b9aa7\") " pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:30.606091 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:30.605538 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:58:30.606091 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:30.605556 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:58:30.606091 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:30.605567 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jtjng for pod openshift-network-diagnostics/network-check-target-dqlm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:30.606091 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:30.605621 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng podName:89ca3d0e-a5af-4f93-af7c-46b8413b9aa7 nodeName:}" failed. No retries permitted until 2026-07-06 20:58:34.605601119 +0000 UTC m=+10.134448914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jtjng" (UniqueName: "kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng") pod "network-check-target-dqlm8" (UID: "89ca3d0e-a5af-4f93-af7c-46b8413b9aa7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:30.606091 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:30.606008 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:30.606091 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:30.606058 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs podName:35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d nodeName:}" failed. No retries permitted until 2026-07-06 20:58:34.606043279 +0000 UTC m=+10.134891062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs") pod "network-metrics-daemon-mlbxf" (UID: "35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:30.707303 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:30.706349 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret\") pod \"global-pull-secret-syncer-f4zwn\" (UID: \"af7599f6-9dd4-4114-9924-17189fb49188\") " pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:30.707303 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:30.706563 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:30.707303 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:30.706624 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret podName:af7599f6-9dd4-4114-9924-17189fb49188 nodeName:}" failed. No retries permitted until 2026-07-06 20:58:34.706608038 +0000 UTC m=+10.235455819 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret") pod "global-pull-secret-syncer-f4zwn" (UID: "af7599f6-9dd4-4114-9924-17189fb49188") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:31.024898 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:31.024409 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:31.024898 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:31.024528 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlbxf" podUID="35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d" Jul 06 20:58:31.024898 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:31.024560 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:31.024898 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:31.024635 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqlm8" podUID="89ca3d0e-a5af-4f93-af7c-46b8413b9aa7" Jul 06 20:58:31.024898 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:31.024685 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:31.024898 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:31.024749 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f4zwn" podUID="af7599f6-9dd4-4114-9924-17189fb49188" Jul 06 20:58:33.026629 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:33.026601 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:33.027028 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:33.026695 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqlm8" podUID="89ca3d0e-a5af-4f93-af7c-46b8413b9aa7" Jul 06 20:58:33.027028 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:33.026868 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:33.027028 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:33.026975 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f4zwn" podUID="af7599f6-9dd4-4114-9924-17189fb49188" Jul 06 20:58:33.027131 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:33.027052 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:33.027164 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:33.027145 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlbxf" podUID="35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d" Jul 06 20:58:34.638755 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:34.638715 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs\") pod \"network-metrics-daemon-mlbxf\" (UID: \"35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d\") " pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:34.639191 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:34.638774 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtjng\" (UniqueName: \"kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng\") pod \"network-check-target-dqlm8\" (UID: \"89ca3d0e-a5af-4f93-af7c-46b8413b9aa7\") " pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:34.639191 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:34.638894 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:34.639191 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:34.638911 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:58:34.639191 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:34.638932 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:58:34.639191 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:34.638945 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jtjng for pod openshift-network-diagnostics/network-check-target-dqlm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:34.639191 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:34.638974 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs podName:35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d nodeName:}" failed. No retries permitted until 2026-07-06 20:58:42.63895305 +0000 UTC m=+18.167800827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs") pod "network-metrics-daemon-mlbxf" (UID: "35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:34.639191 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:34.638999 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng podName:89ca3d0e-a5af-4f93-af7c-46b8413b9aa7 nodeName:}" failed. No retries permitted until 2026-07-06 20:58:42.638982484 +0000 UTC m=+18.167830284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jtjng" (UniqueName: "kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng") pod "network-check-target-dqlm8" (UID: "89ca3d0e-a5af-4f93-af7c-46b8413b9aa7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:34.739385 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:34.739344 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret\") pod \"global-pull-secret-syncer-f4zwn\" (UID: \"af7599f6-9dd4-4114-9924-17189fb49188\") " pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:34.739577 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:34.739479 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:34.739577 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:34.739562 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret podName:af7599f6-9dd4-4114-9924-17189fb49188 nodeName:}" failed. No retries permitted until 2026-07-06 20:58:42.739543214 +0000 UTC m=+18.268391004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret") pod "global-pull-secret-syncer-f4zwn" (UID: "af7599f6-9dd4-4114-9924-17189fb49188") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:35.025686 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:35.025607 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:35.025842 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:35.025721 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqlm8" podUID="89ca3d0e-a5af-4f93-af7c-46b8413b9aa7" Jul 06 20:58:35.026090 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:35.026069 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:35.026214 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:35.026179 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlbxf" podUID="35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d" Jul 06 20:58:35.026260 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:35.026223 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:35.026309 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:35.026286 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f4zwn" podUID="af7599f6-9dd4-4114-9924-17189fb49188" Jul 06 20:58:37.026449 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:37.026419 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:37.026939 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:37.026559 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqlm8" podUID="89ca3d0e-a5af-4f93-af7c-46b8413b9aa7" Jul 06 20:58:37.027005 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:37.026942 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:37.027054 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:37.027025 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlbxf" podUID="35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d" Jul 06 20:58:37.027096 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:37.027079 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:37.027168 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:37.027144 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f4zwn" podUID="af7599f6-9dd4-4114-9924-17189fb49188" Jul 06 20:58:39.022570 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:39.022472 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:39.022998 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:39.022473 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:39.022998 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:39.022624 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqlm8" podUID="89ca3d0e-a5af-4f93-af7c-46b8413b9aa7" Jul 06 20:58:39.022998 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:39.022473 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:39.022998 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:39.022706 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f4zwn" podUID="af7599f6-9dd4-4114-9924-17189fb49188" Jul 06 20:58:39.022998 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:39.022839 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlbxf" podUID="35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d" Jul 06 20:58:41.022835 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:41.022794 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:41.023254 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:41.022794 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:41.023254 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:41.022939 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:41.023254 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:41.022935 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlbxf" podUID="35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d" Jul 06 20:58:41.023254 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:41.023038 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f4zwn" podUID="af7599f6-9dd4-4114-9924-17189fb49188" Jul 06 20:58:41.023254 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:41.023114 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqlm8" podUID="89ca3d0e-a5af-4f93-af7c-46b8413b9aa7" Jul 06 20:58:42.707279 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:42.707193 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtjng\" (UniqueName: \"kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng\") pod \"network-check-target-dqlm8\" (UID: \"89ca3d0e-a5af-4f93-af7c-46b8413b9aa7\") " pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:42.707707 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:42.707294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs\") pod \"network-metrics-daemon-mlbxf\" (UID: \"35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d\") " pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:42.707707 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:42.707385 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:58:42.707707 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:42.707420 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:58:42.707707 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:42.707436 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jtjng for pod openshift-network-diagnostics/network-check-target-dqlm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:42.707707 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:42.707390 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:42.707707 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:42.707510 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng podName:89ca3d0e-a5af-4f93-af7c-46b8413b9aa7 nodeName:}" failed. No retries permitted until 2026-07-06 20:58:58.707479201 +0000 UTC m=+34.236326978 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jtjng" (UniqueName: "kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng") pod "network-check-target-dqlm8" (UID: "89ca3d0e-a5af-4f93-af7c-46b8413b9aa7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:42.707707 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:42.707589 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs podName:35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d nodeName:}" failed. No retries permitted until 2026-07-06 20:58:58.707567717 +0000 UTC m=+34.236415500 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs") pod "network-metrics-daemon-mlbxf" (UID: "35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:42.808511 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:42.808464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret\") pod \"global-pull-secret-syncer-f4zwn\" (UID: \"af7599f6-9dd4-4114-9924-17189fb49188\") " pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:42.808686 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:42.808607 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:42.808686 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:42.808681 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret podName:af7599f6-9dd4-4114-9924-17189fb49188 nodeName:}" failed. No retries permitted until 2026-07-06 20:58:58.808664665 +0000 UTC m=+34.337512442 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret") pod "global-pull-secret-syncer-f4zwn" (UID: "af7599f6-9dd4-4114-9924-17189fb49188") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:43.023450 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:43.023324 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:43.023450 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:43.023354 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:43.023450 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:43.023325 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:43.023741 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:43.023468 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlbxf" podUID="35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d" Jul 06 20:58:43.023741 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:43.023607 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f4zwn" podUID="af7599f6-9dd4-4114-9924-17189fb49188" Jul 06 20:58:43.023741 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:43.023692 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqlm8" podUID="89ca3d0e-a5af-4f93-af7c-46b8413b9aa7" Jul 06 20:58:45.024315 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:45.023218 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:45.024315 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:45.023327 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlbxf" podUID="35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d" Jul 06 20:58:45.024315 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:45.023732 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:45.024315 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:45.023811 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f4zwn" podUID="af7599f6-9dd4-4114-9924-17189fb49188" Jul 06 20:58:45.024315 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:45.024099 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:45.024315 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:45.024162 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqlm8" podUID="89ca3d0e-a5af-4f93-af7c-46b8413b9aa7" Jul 06 20:58:47.022481 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:47.022428 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:47.022481 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:47.022440 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:47.022932 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:47.022570 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f4zwn" podUID="af7599f6-9dd4-4114-9924-17189fb49188" Jul 06 20:58:47.022932 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:47.022631 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqlm8" podUID="89ca3d0e-a5af-4f93-af7c-46b8413b9aa7" Jul 06 20:58:47.022932 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:47.022689 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:47.022932 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:47.022791 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlbxf" podUID="35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d" Jul 06 20:58:48.157675 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.157266 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cf2gt" event={"ID":"0baf1d79-4121-4204-930a-08a0ada71541","Type":"ContainerStarted","Data":"c643368399311ec7ca0e2a6361ab4ddb7af008b9287ec68fbb9ec2a14260fbaa"} Jul 06 20:58:48.159867 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.159842 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-knjjg" event={"ID":"a933fdae-34bf-47b1-a811-908317f0df93","Type":"ContainerStarted","Data":"296baa0beceb7b6d8b9ce1148936a6b50eabb24814cd273234fc479415ebedcc"} Jul 06 20:58:48.161568 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.161519 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qkvhj" event={"ID":"6a8decb1-c467-42ec-a869-211c576ae380","Type":"ContainerStarted","Data":"b88ffc5a47fa5b46f2b2ddb9568152cd813043140888b34cfa3e834e6962c26c"} Jul 06 20:58:48.163308 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.163281 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" event={"ID":"6502f4dc-9d3e-438c-bfee-82b50649fe28","Type":"ContainerStarted","Data":"46021d945b743e5f22d345a701d73cca1fa78ae24b64c17fe2a2d6c083809ece"} Jul 06 20:58:48.164998 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.164966 2564 generic.go:356] "Generic (PLEG): container finished" podID="ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d" containerID="412065d9513031fbeca1e701a0588a6e9b636d917518356d2fb65fb4c0a5713d" exitCode=0 Jul 06 20:58:48.165101 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.165045 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hwpl" event={"ID":"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d","Type":"ContainerDied","Data":"412065d9513031fbeca1e701a0588a6e9b636d917518356d2fb65fb4c0a5713d"} Jul 06 20:58:48.166739 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.166609 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6fb64" event={"ID":"14dfea34-a9cf-4d9a-a693-240ffbadeff1","Type":"ContainerStarted","Data":"e39cd82b755ca87d4c989a93f81901e7417036b8994bbab15df0b8a253d1439f"} Jul 06 20:58:48.168980 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.168958 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" event={"ID":"8aa7ee406116a1f7fce36ddc8789b8d7","Type":"ContainerStarted","Data":"b64053ba282dff17ada091214b2434f96d1c8aac0b40c72bf54ed351912db90a"} Jul 06 20:58:48.170765 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.170710 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" event={"ID":"172acbde-98a9-4caa-84e8-1bdc4bd16242","Type":"ContainerStarted","Data":"a803d02b3d2c8eb70428a79163214fd499c5a11c234aa57d64d67df715d94b49"} Jul 06 20:58:48.174370 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.174346 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 20:58:48.174687 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.174631 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cf2gt" podStartSLOduration=4.525263602 podStartE2EDuration="23.174609588s" totalImagesPullingTime="18.649345986s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:58:48.173963028 +0000 UTC m=+23.702810819" watchObservedRunningTime="2026-07-06 20:58:48.174609588 +0000 UTC m=+23.703457388" Jul 06 20:58:48.176984 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.176316 2564 generic.go:356] "Generic (PLEG): container finished" podID="41b93806-bd40-4596-b076-ef109dd4e9a7" containerID="0d9b8508bc6145f612ac7d9cfffff4a52dda28f0c5d418c17b7fbd285bac5c19" exitCode=1 Jul 06 20:58:48.176984 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.176360 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" event={"ID":"41b93806-bd40-4596-b076-ef109dd4e9a7","Type":"ContainerStarted","Data":"8e6b12cae736e549270d2a0a7384419ced6ea19e43b541c246ed7aaedfab2824"} Jul 06 20:58:48.176984 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.176467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" event={"ID":"41b93806-bd40-4596-b076-ef109dd4e9a7","Type":"ContainerStarted","Data":"d21ef919f60d3cc0dbf7917bb60a23ade385c6d15776703e6c64f414c89a6188"} Jul 06 20:58:48.176984 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.176551 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" event={"ID":"41b93806-bd40-4596-b076-ef109dd4e9a7","Type":"ContainerStarted","Data":"69de061e505d39230926d9012b44fdcbf2e030c699c0d5634976f5b80b185a3b"} Jul 06 20:58:48.176984 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.176616 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" event={"ID":"41b93806-bd40-4596-b076-ef109dd4e9a7","Type":"ContainerStarted","Data":"51507d15fce84d522166b98c798cdbb60e9fdaab313b7bfa349c2a6ab00c23df"} Jul 06 20:58:48.176984 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.176678 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" event={"ID":"41b93806-bd40-4596-b076-ef109dd4e9a7","Type":"ContainerDied","Data":"0d9b8508bc6145f612ac7d9cfffff4a52dda28f0c5d418c17b7fbd285bac5c19"} Jul 06 20:58:48.176984 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.176739 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" event={"ID":"41b93806-bd40-4596-b076-ef109dd4e9a7","Type":"ContainerStarted","Data":"9ccdd3ec493abad07e6be4c30b836869938099a636344de280a38cde3e714045"} Jul 06 20:58:48.192465 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.192419 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-knjjg" podStartSLOduration=8.1313461 podStartE2EDuration="23.192403782s" totalImagesPullingTime="15.061057682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:58:48.192125872 +0000 UTC m=+23.720973666" watchObservedRunningTime="2026-07-06 20:58:48.192403782 +0000 UTC m=+23.721251581" Jul 06 20:58:48.216703 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.216649 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qkvhj" podStartSLOduration=4.539436763 podStartE2EDuration="23.216637406s" totalImagesPullingTime="18.677200643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:58:48.215836776 +0000 UTC m=+23.744684574" watchObservedRunningTime="2026-07-06 20:58:48.216637406 +0000 UTC m=+23.745485209" Jul 06 20:58:48.236453 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.236364 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-226.ec2.internal" podStartSLOduration=22.236345156 podStartE2EDuration="22.236345156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:58:48.235776321 +0000 UTC m=+23.764624120" watchObservedRunningTime="2026-07-06 20:58:48.236345156 +0000 UTC m=+23.765192957" Jul 06 20:58:48.251689 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.251649 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6fb64" podStartSLOduration=9.230067817 podStartE2EDuration="23.251635335s" totalImagesPullingTime="14.021567518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:58:48.251201199 +0000 UTC m=+23.780048997" watchObservedRunningTime="2026-07-06 20:58:48.251635335 +0000 UTC m=+23.780483134" Jul 06 20:58:48.271602 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.271558 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qq8j8" podStartSLOduration=4.633468138 podStartE2EDuration="23.271545058s" totalImagesPullingTime="18.63807692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:58:48.271492235 +0000 UTC m=+23.800340033" watchObservedRunningTime="2026-07-06 20:58:48.271545058 +0000 UTC m=+23.800392857" Jul 06 20:58:48.607886 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:48.607749 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 20:58:49.022718 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:49.022572 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T20:58:48.607882318Z","UUID":"ae2773f0-4ebf-4d18-869c-29acd89a51a3","Handler":null,"Name":"","Endpoint":""} Jul 06 20:58:49.022718 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:49.022718 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:49.023059 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:49.022749 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:49.023059 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:49.022718 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:49.023059 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:49.022891 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f4zwn" podUID="af7599f6-9dd4-4114-9924-17189fb49188" Jul 06 20:58:49.023059 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:49.022991 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqlm8" podUID="89ca3d0e-a5af-4f93-af7c-46b8413b9aa7" Jul 06 20:58:49.023261 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:49.023071 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlbxf" podUID="35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d" Jul 06 20:58:49.023953 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:49.023930 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 20:58:49.024058 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:49.023966 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 20:58:49.161889 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:49.161857 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6fb64" Jul 06 20:58:49.162362 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:49.162342 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6fb64" Jul 06 20:58:49.180833 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:49.180801 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" event={"ID":"172acbde-98a9-4caa-84e8-1bdc4bd16242","Type":"ContainerStarted","Data":"26a6699d2a5898ca27b50b1c53274f7c7b67e41dc9c4870e045c0c28d78309ea"} Jul 06 20:58:49.182564 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:49.182530 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f8klt" event={"ID":"a41b2821-807f-47c8-b65a-548a8c67c149","Type":"ContainerStarted","Data":"c2791de5a9e7352a72a25bc1c67f8e56e926176f74585a8e8cfe8b5f2a2eb862"} Jul 06 20:58:49.182965 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:49.182907 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6fb64" Jul 06 20:58:49.183408 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:49.183391 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6fb64" Jul 06 20:58:49.204360 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:49.204312 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f8klt" podStartSLOduration=5.570923123 podStartE2EDuration="24.204298715s" totalImagesPullingTime="18.633375592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:58:49.204278364 +0000 UTC m=+24.733126164" watchObservedRunningTime="2026-07-06 20:58:49.204298715 +0000 UTC m=+24.733146513" Jul 06 20:58:50.187269 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:50.187234 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" event={"ID":"172acbde-98a9-4caa-84e8-1bdc4bd16242","Type":"ContainerStarted","Data":"a8c9e86ef7a55864940a5a56ecc02050e8f57c9df2e664a0d86d54f1c1977dfd"} Jul 06 20:58:50.210241 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:50.210195 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2hzl" podStartSLOduration=3.936897891 podStartE2EDuration="25.210178369s" totalImagesPullingTime="21.273280478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:58:50.208946757 +0000 UTC m=+25.737794558" watchObservedRunningTime="2026-07-06 20:58:50.210178369 +0000 UTC m=+25.739026167" Jul 06 20:58:51.022631 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:51.022601 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:51.022794 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:51.022601 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:51.022794 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:51.022714 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqlm8" podUID="89ca3d0e-a5af-4f93-af7c-46b8413b9aa7" Jul 06 20:58:51.022891 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:51.022796 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f4zwn" podUID="af7599f6-9dd4-4114-9924-17189fb49188" Jul 06 20:58:51.022891 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:51.022601 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:51.022959 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:51.022910 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlbxf" podUID="35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d" Jul 06 20:58:51.192326 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:51.192295 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 20:58:51.192959 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:51.192699 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" event={"ID":"41b93806-bd40-4596-b076-ef109dd4e9a7","Type":"ContainerStarted","Data":"a543b676f24c1e5c5138efda37c429bc795c04768b521ad1f0b54ed10e8d7287"} Jul 06 20:58:53.023095 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:53.022912 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:53.023712 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:53.022922 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:53.023712 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:53.023175 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlbxf" podUID="35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d" Jul 06 20:58:53.023712 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:53.022955 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:53.023712 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:53.023239 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f4zwn" podUID="af7599f6-9dd4-4114-9924-17189fb49188" Jul 06 20:58:53.023712 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:53.023298 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqlm8" podUID="89ca3d0e-a5af-4f93-af7c-46b8413b9aa7" Jul 06 20:58:53.200904 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:53.200877 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 20:58:53.201273 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:53.201245 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" event={"ID":"41b93806-bd40-4596-b076-ef109dd4e9a7","Type":"ContainerStarted","Data":"98bf5eb5f7b636adc805e7898633ad33cadab4dbffc1942c393f52672f062f90"} Jul 06 20:58:53.201562 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:53.201535 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:53.201723 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:53.201710 2564 scope.go:117] "RemoveContainer" containerID="0d9b8508bc6145f612ac7d9cfffff4a52dda28f0c5d418c17b7fbd285bac5c19" Jul 06 20:58:53.219307 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:53.219285 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:54.475465 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:54.475354 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f4zwn"] Jul 06 20:58:54.475786 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:54.475488 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:54.475786 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:54.475590 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f4zwn" podUID="af7599f6-9dd4-4114-9924-17189fb49188" Jul 06 20:58:54.480627 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:54.480593 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mlbxf"] Jul 06 20:58:54.480729 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:54.480722 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:54.480853 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:54.480834 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlbxf" podUID="35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d" Jul 06 20:58:54.481341 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:54.481319 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dqlm8"] Jul 06 20:58:54.481418 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:54.481405 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:54.481532 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:54.481484 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqlm8" podUID="89ca3d0e-a5af-4f93-af7c-46b8413b9aa7" Jul 06 20:58:55.209102 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:55.208943 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 20:58:55.209467 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:55.209438 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" event={"ID":"41b93806-bd40-4596-b076-ef109dd4e9a7","Type":"ContainerStarted","Data":"f1ed21d6b24d11ac3783e4dc6f23b1c8874ddcd0c6aceb6a04f13384ce93b3ac"} Jul 06 20:58:55.209769 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:55.209748 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:55.209875 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:55.209828 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:55.211424 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:55.211399 2564 generic.go:356] "Generic (PLEG): container finished" podID="ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d" containerID="638dd9bed2a53dd028b8149227541c74cf4c4c36f7b7163657bd2faa274f5f3f" exitCode=0 Jul 06 20:58:55.211539 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:55.211440 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hwpl" event={"ID":"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d","Type":"ContainerDied","Data":"638dd9bed2a53dd028b8149227541c74cf4c4c36f7b7163657bd2faa274f5f3f"} Jul 06 20:58:55.226902 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:55.226881 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:58:55.291510 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:55.291455 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" podStartSLOduration=11.253189485 podStartE2EDuration="30.29144021s" totalImagesPullingTime="19.038250725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:58:55.256791183 +0000 UTC m=+30.785638994" watchObservedRunningTime="2026-07-06 20:58:55.29144021 +0000 UTC m=+30.820288008" Jul 06 20:58:56.022699 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:56.022624 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:56.023262 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:56.022743 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:56.023262 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:56.022754 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqlm8" podUID="89ca3d0e-a5af-4f93-af7c-46b8413b9aa7" Jul 06 20:58:56.023262 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:56.022778 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:56.023262 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:56.022965 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f4zwn" podUID="af7599f6-9dd4-4114-9924-17189fb49188" Jul 06 20:58:56.023262 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:56.023061 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlbxf" podUID="35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d" Jul 06 20:58:57.217894 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:57.217862 2564 generic.go:356] "Generic (PLEG): container finished" podID="ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d" containerID="3fd89b1df22901bb6254992deddff76bb732ba67a8a4e935431be1ecc2172bc0" exitCode=0 Jul 06 20:58:57.218626 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:57.217940 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hwpl" event={"ID":"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d","Type":"ContainerDied","Data":"3fd89b1df22901bb6254992deddff76bb732ba67a8a4e935431be1ecc2172bc0"} Jul 06 20:58:57.228913 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:57.228883 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" podUID="41b93806-bd40-4596-b076-ef109dd4e9a7" containerName="ovnkube-controller" probeResult="failure" output="" Jul 06 20:58:58.022888 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:58.022865 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:58.022973 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:58.022944 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:58.022973 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:58.022961 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:58.023050 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:58.023032 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqlm8" podUID="89ca3d0e-a5af-4f93-af7c-46b8413b9aa7" Jul 06 20:58:58.023123 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:58.023099 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f4zwn" podUID="af7599f6-9dd4-4114-9924-17189fb49188" Jul 06 20:58:58.023227 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:58.023205 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mlbxf" podUID="35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d" Jul 06 20:58:58.221863 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:58.221784 2564 generic.go:356] "Generic (PLEG): container finished" podID="ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d" containerID="a615328215a65a635a8685716b3494562fe05f022d19862677dcd7bbf4e4f110" exitCode=0 Jul 06 20:58:58.221863 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:58.221838 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hwpl" event={"ID":"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d","Type":"ContainerDied","Data":"a615328215a65a635a8685716b3494562fe05f022d19862677dcd7bbf4e4f110"} Jul 06 20:58:58.727537 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:58.727488 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs\") pod \"network-metrics-daemon-mlbxf\" (UID: \"35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d\") " pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:58:58.727703 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:58.727545 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtjng\" (UniqueName: \"kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng\") pod \"network-check-target-dqlm8\" (UID: \"89ca3d0e-a5af-4f93-af7c-46b8413b9aa7\") " pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:58:58.727703 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:58.727629 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:58.727703 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:58.727657 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:58:58.727703 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:58.727678 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:58:58.727703 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:58.727689 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jtjng for pod openshift-network-diagnostics/network-check-target-dqlm8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:58.727859 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:58.727689 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs podName:35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d nodeName:}" failed. No retries permitted until 2026-07-06 20:59:30.727672249 +0000 UTC m=+66.256520026 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs") pod "network-metrics-daemon-mlbxf" (UID: "35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:58:58.727859 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:58.727733 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng podName:89ca3d0e-a5af-4f93-af7c-46b8413b9aa7 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:30.727720416 +0000 UTC m=+66.256568192 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jtjng" (UniqueName: "kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng") pod "network-check-target-dqlm8" (UID: "89ca3d0e-a5af-4f93-af7c-46b8413b9aa7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:58:58.827847 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:58.827814 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret\") pod \"global-pull-secret-syncer-f4zwn\" (UID: \"af7599f6-9dd4-4114-9924-17189fb49188\") " pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:58:58.828043 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:58.827966 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:58.828043 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:58:58.828018 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret podName:af7599f6-9dd4-4114-9924-17189fb49188 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:30.828005359 +0000 UTC m=+66.356853136 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret") pod "global-pull-secret-syncer-f4zwn" (UID: "af7599f6-9dd4-4114-9924-17189fb49188") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:58:59.806476 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.806319 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-226.ec2.internal" event="NodeReady" Jul 06 20:58:59.806839 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.806586 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 20:58:59.866957 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.865748 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-687697f894-mgcsd"] Jul 06 20:58:59.867801 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.867778 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl"] Jul 06 20:58:59.867911 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.867895 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:58:59.869483 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.869454 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7df99b5f7c-g9r85"] Jul 06 20:58:59.870206 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.870186 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl" Jul 06 20:58:59.871020 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.870999 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss"] Jul 06 20:58:59.871131 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.871080 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:58:59.873029 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.872775 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" Jul 06 20:58:59.874511 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.874479 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 20:58:59.878046 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.878023 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 20:58:59.878141 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.878086 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 20:58:59.878141 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.878102 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 20:58:59.878309 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.878288 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xmrw6\"" Jul 06 20:58:59.878473 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.878458 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 20:58:59.878609 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.878023 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:58:59.878648 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.878617 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 20:58:59.879493 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.879469 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 20:58:59.882164 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.879858 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 20:58:59.882164 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.879863 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pqgxr\"" Jul 06 20:58:59.882164 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.881482 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 20:58:59.882164 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.881745 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 20:58:59.882164 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.881933 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 20:58:59.882164 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.881964 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 20:58:59.882164 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.882063 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 20:58:59.882566 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.882175 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 20:58:59.882566 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.882189 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 20:58:59.882566 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.882367 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-svlrn\"" Jul 06 20:58:59.885472 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.885453 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 20:58:59.886579 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.886559 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dhdp7\"" Jul 06 20:58:59.887096 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.887076 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-592fg"] Jul 06 20:58:59.889049 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.889025 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-s7bvx"] Jul 06 20:58:59.889527 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.889468 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:58:59.891571 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.891552 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq"] Jul 06 20:58:59.891684 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.891665 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-s7bvx" Jul 06 20:58:59.894082 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.894067 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-z8vzb"] Jul 06 20:58:59.894187 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.894174 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq" Jul 06 20:58:59.895769 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.895751 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl"] Jul 06 20:58:59.895861 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.895840 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" Jul 06 20:58:59.913860 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.913839 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 20:58:59.913996 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.913959 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 20:58:59.914278 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.914261 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 20:58:59.914536 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.914382 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-45kbv\"" Jul 06 20:58:59.914536 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.914433 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 20:58:59.914673 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.914309 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 20:58:59.914717 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.914675 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 20:58:59.914717 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.914677 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:58:59.914947 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.914817 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:58:59.917420 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.917401 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-trqg6\"" Jul 06 20:58:59.917569 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.917420 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 20:58:59.917569 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.917458 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-272kr\"" Jul 06 20:58:59.917569 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.917545 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7qd74\"" Jul 06 20:58:59.921198 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.921181 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-687697f894-mgcsd"] Jul 06 20:58:59.924100 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.924079 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-592fg"] Jul 06 20:58:59.925177 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.925160 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-z8vzb"] Jul 06 20:58:59.926002 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.925981 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 20:58:59.926576 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.926360 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 20:58:59.933678 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.933647 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 20:58:59.933785 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.933768 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:58:59.933927 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.933677 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 20:58:59.934005 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.933985 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 20:58:59.939960 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.938833 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 20:58:59.943563 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.943538 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7df99b5f7c-g9r85"] Jul 06 20:58:59.944881 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.944864 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss"] Jul 06 20:58:59.945020 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.944906 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-jw6qp"] Jul 06 20:58:59.947009 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.946992 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-s7bvx"] Jul 06 20:58:59.947117 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.947084 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jw6qp" Jul 06 20:58:59.947675 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.947656 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc"] Jul 06 20:58:59.949609 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.949588 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc" Jul 06 20:58:59.949928 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.949906 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq"] Jul 06 20:58:59.952719 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.952702 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 20:58:59.952892 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.952879 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:58:59.953693 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.953675 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:58:59.954647 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.954630 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-mg5km\"" Jul 06 20:58:59.955395 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.955379 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-cj7pc\"" Jul 06 20:58:59.955484 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.955382 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 20:58:59.957317 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.957296 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 20:58:59.959445 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.959427 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:58:59.974285 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.974265 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rqt9r"] Jul 06 20:58:59.984985 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.984086 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6r4bb"] Jul 06 20:58:59.984985 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.984169 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rqt9r" Jul 06 20:58:59.989003 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.988976 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 20:58:59.989089 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.988997 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 20:58:59.989301 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.989286 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jz828\"" Jul 06 20:58:59.989559 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.989543 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 20:58:59.994194 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.994160 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc"] Jul 06 20:58:59.994194 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.994193 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-jw6qp"] Jul 06 20:58:59.994337 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:58:59.994272 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:00.000449 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.000419 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rqt9r"] Jul 06 20:59:00.003303 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.003280 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 20:59:00.003720 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.003576 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-27mml\"" Jul 06 20:59:00.003720 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.003691 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 20:59:00.009887 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.009867 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6r4bb"] Jul 06 20:59:00.022887 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.022860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:59:00.023024 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.022897 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:59:00.023024 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.022869 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:59:00.036401 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.036378 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2tvmd\"" Jul 06 20:59:00.037719 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.037701 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:59:00.038082 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2nkv\" (UniqueName: \"kubernetes.io/projected/ebfdc233-cfa7-4ca5-95c2-9a0872c415c9-kube-api-access-k2nkv\") pod \"service-ca-operator-5d46d9ffd4-n6nxc\" (UID: \"ebfdc233-cfa7-4ca5-95c2-9a0872c415c9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc" Jul 06 20:59:00.038200 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038099 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-default-certificate\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:00.038200 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038129 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.038306 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038222 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/819a8df1-a532-4fa1-8adc-5b55e8301925-ca-trust-extracted\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.038359 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038297 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trn8k\" (UniqueName: \"kubernetes.io/projected/16ffece4-6447-47d6-a16d-aafe0117f6e9-kube-api-access-trn8k\") pod \"insights-operator-5c847dcfc4-592fg\" (UID: \"16ffece4-6447-47d6-a16d-aafe0117f6e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.038359 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038338 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16ffece4-6447-47d6-a16d-aafe0117f6e9-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-592fg\" (UID: \"16ffece4-6447-47d6-a16d-aafe0117f6e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.038456 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038364 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/819a8df1-a532-4fa1-8adc-5b55e8301925-installation-pull-secrets\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.038456 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038388 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a3f837b9-6181-468c-a74e-70d104adfdae-serving-cert\") pod \"console-operator-68b757fb67-z8vzb\" (UID: \"a3f837b9-6181-468c-a74e-70d104adfdae\") " pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" Jul 06 20:59:00.038456 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038430 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:00.038456 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038452 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/819a8df1-a532-4fa1-8adc-5b55e8301925-image-registry-private-configuration\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.038671 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038469 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/819a8df1-a532-4fa1-8adc-5b55e8301925-trusted-ca\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.038671 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038488 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f42135c2-6517-4bbf-a412-acb2e43c9b8c-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-slfss\" (UID: \"f42135c2-6517-4bbf-a412-acb2e43c9b8c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" Jul 06 20:59:00.038671 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038520 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebfdc233-cfa7-4ca5-95c2-9a0872c415c9-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-n6nxc\" (UID: \"ebfdc233-cfa7-4ca5-95c2-9a0872c415c9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc" Jul 06 20:59:00.038671 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038586 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-bound-sa-token\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.038671 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038661 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16ffece4-6447-47d6-a16d-aafe0117f6e9-tmp\") pod \"insights-operator-5c847dcfc4-592fg\" (UID: \"16ffece4-6447-47d6-a16d-aafe0117f6e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.038863 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79b1e6af-13f8-4946-ae15-78db17d10d04-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-xvqtl\" (UID: \"79b1e6af-13f8-4946-ae15-78db17d10d04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl" Jul 06 20:59:00.038863 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrqs7\" (UniqueName: \"kubernetes.io/projected/5a68b42b-1cb7-4068-b285-59215061f0b1-kube-api-access-nrqs7\") pod \"network-check-source-989f8b8dc-jw6qp\" (UID: \"5a68b42b-1cb7-4068-b285-59215061f0b1\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jw6qp" Jul 06 20:59:00.038863 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038776 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebfdc233-cfa7-4ca5-95c2-9a0872c415c9-config\") pod \"service-ca-operator-5d46d9ffd4-n6nxc\" (UID: \"ebfdc233-cfa7-4ca5-95c2-9a0872c415c9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc" Jul 06 20:59:00.038863 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038830 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79b1e6af-13f8-4946-ae15-78db17d10d04-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-xvqtl\" (UID: \"79b1e6af-13f8-4946-ae15-78db17d10d04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl" Jul 06 20:59:00.039046 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038874 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16ffece4-6447-47d6-a16d-aafe0117f6e9-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-592fg\" (UID: \"16ffece4-6447-47d6-a16d-aafe0117f6e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.039046 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038901 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htmxk\" (UniqueName: \"kubernetes.io/projected/8c7a20d2-0d6c-42df-937a-7933d6a612ac-kube-api-access-htmxk\") pod \"cluster-samples-operator-56fcf86bf-25wgq\" (UID: \"8c7a20d2-0d6c-42df-937a-7933d6a612ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq" Jul 06 20:59:00.039046 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038920 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/16ffece4-6447-47d6-a16d-aafe0117f6e9-snapshots\") pod \"insights-operator-5c847dcfc4-592fg\" (UID: \"16ffece4-6447-47d6-a16d-aafe0117f6e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.039046 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038936 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-slfss\" (UID: \"f42135c2-6517-4bbf-a412-acb2e43c9b8c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" Jul 06 20:59:00.039046 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038952 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8zqh\" (UniqueName: \"kubernetes.io/projected/f42135c2-6517-4bbf-a412-acb2e43c9b8c-kube-api-access-s8zqh\") pod \"cluster-monitoring-operator-64786d9cbb-slfss\" (UID: \"f42135c2-6517-4bbf-a412-acb2e43c9b8c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" Jul 06 20:59:00.039046 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038968 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-certificates\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.039046 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.038991 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqqcq\" (UniqueName: \"kubernetes.io/projected/79b1e6af-13f8-4946-ae15-78db17d10d04-kube-api-access-nqqcq\") pod \"kube-storage-version-migrator-operator-846bf668f7-xvqtl\" (UID: \"79b1e6af-13f8-4946-ae15-78db17d10d04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl" Jul 06 20:59:00.039046 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.039031 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:00.039046 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.039048 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-stats-auth\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:00.039359 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.039090 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n6zn\" (UniqueName: \"kubernetes.io/projected/a3f837b9-6181-468c-a74e-70d104adfdae-kube-api-access-5n6zn\") pod \"console-operator-68b757fb67-z8vzb\" (UID: \"a3f837b9-6181-468c-a74e-70d104adfdae\") " pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" Jul 06 20:59:00.039359 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.039139 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-25wgq\" (UID: \"8c7a20d2-0d6c-42df-937a-7933d6a612ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq" Jul 06 20:59:00.039359 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.039164 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a3f837b9-6181-468c-a74e-70d104adfdae-trusted-ca\") pod \"console-operator-68b757fb67-z8vzb\" (UID: \"a3f837b9-6181-468c-a74e-70d104adfdae\") " pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" Jul 06 20:59:00.039359 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.039189 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-694pp\" (UniqueName: \"kubernetes.io/projected/a1772b59-30ba-434b-b201-19ab05b7f824-kube-api-access-694pp\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:00.039359 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.039225 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hlbp\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-kube-api-access-6hlbp\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.039359 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.039249 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a3f837b9-6181-468c-a74e-70d104adfdae-config\") pod \"console-operator-68b757fb67-z8vzb\" (UID: \"a3f837b9-6181-468c-a74e-70d104adfdae\") " pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" Jul 06 20:59:00.039359 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.039299 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16ffece4-6447-47d6-a16d-aafe0117f6e9-serving-cert\") pod \"insights-operator-5c847dcfc4-592fg\" (UID: \"16ffece4-6447-47d6-a16d-aafe0117f6e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.039359 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.039335 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpjrs\" (UniqueName: \"kubernetes.io/projected/ecb7d917-0d0b-47a6-8756-d579096a6c11-kube-api-access-rpjrs\") pod \"volume-data-source-validator-5d456fdbcd-s7bvx\" (UID: \"ecb7d917-0d0b-47a6-8756-d579096a6c11\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-s7bvx" Jul 06 20:59:00.045572 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.045552 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7wh5f\"" Jul 06 20:59:00.081251 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.081226 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:59:00.140804 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.140724 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6t99\" (UniqueName: \"kubernetes.io/projected/ba87842f-c445-41bd-9656-bc4a83369b6b-kube-api-access-g6t99\") pod \"dns-default-6r4bb\" (UID: \"ba87842f-c445-41bd-9656-bc4a83369b6b\") " pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:00.140804 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.140777 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqqcq\" (UniqueName: \"kubernetes.io/projected/79b1e6af-13f8-4946-ae15-78db17d10d04-kube-api-access-nqqcq\") pod \"kube-storage-version-migrator-operator-846bf668f7-xvqtl\" (UID: \"79b1e6af-13f8-4946-ae15-78db17d10d04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl" Jul 06 20:59:00.141007 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.140823 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba87842f-c445-41bd-9656-bc4a83369b6b-tmp-dir\") pod \"dns-default-6r4bb\" (UID: \"ba87842f-c445-41bd-9656-bc4a83369b6b\") " pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:00.141007 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.140887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:00.141007 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.140915 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-stats-auth\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:00.141007 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.140941 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6zn\" (UniqueName: \"kubernetes.io/projected/a3f837b9-6181-468c-a74e-70d104adfdae-kube-api-access-5n6zn\") pod \"console-operator-68b757fb67-z8vzb\" (UID: \"a3f837b9-6181-468c-a74e-70d104adfdae\") " pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" Jul 06 20:59:00.141007 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.140962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-25wgq\" (UID: \"8c7a20d2-0d6c-42df-937a-7933d6a612ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq" Jul 06 20:59:00.141007 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.140985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a3f837b9-6181-468c-a74e-70d104adfdae-trusted-ca\") pod \"console-operator-68b757fb67-z8vzb\" (UID: \"a3f837b9-6181-468c-a74e-70d104adfdae\") " pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" Jul 06 20:59:00.141290 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-694pp\" (UniqueName: \"kubernetes.io/projected/a1772b59-30ba-434b-b201-19ab05b7f824-kube-api-access-694pp\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:00.141290 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.141043 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle podName:a1772b59-30ba-434b-b201-19ab05b7f824 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:00.64102309 +0000 UTC m=+36.169870886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle") pod "router-default-7df99b5f7c-g9r85" (UID: "a1772b59-30ba-434b-b201-19ab05b7f824") : configmap references non-existent config key: service-ca.crt Jul 06 20:59:00.141290 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141072 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hlbp\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-kube-api-access-6hlbp\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.141290 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141105 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a3f837b9-6181-468c-a74e-70d104adfdae-config\") pod \"console-operator-68b757fb67-z8vzb\" (UID: \"a3f837b9-6181-468c-a74e-70d104adfdae\") " pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" Jul 06 20:59:00.141290 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141136 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16ffece4-6447-47d6-a16d-aafe0117f6e9-serving-cert\") pod \"insights-operator-5c847dcfc4-592fg\" (UID: \"16ffece4-6447-47d6-a16d-aafe0117f6e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.141290 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.141146 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 20:59:00.141290 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141167 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpjrs\" (UniqueName: \"kubernetes.io/projected/ecb7d917-0d0b-47a6-8756-d579096a6c11-kube-api-access-rpjrs\") pod \"volume-data-source-validator-5d456fdbcd-s7bvx\" (UID: \"ecb7d917-0d0b-47a6-8756-d579096a6c11\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-s7bvx" Jul 06 20:59:00.141290 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2nkv\" (UniqueName: \"kubernetes.io/projected/ebfdc233-cfa7-4ca5-95c2-9a0872c415c9-kube-api-access-k2nkv\") pod \"service-ca-operator-5d46d9ffd4-n6nxc\" (UID: \"ebfdc233-cfa7-4ca5-95c2-9a0872c415c9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc" Jul 06 20:59:00.141290 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.141219 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls podName:8c7a20d2-0d6c-42df-937a-7933d6a612ac nodeName:}" failed. No retries permitted until 2026-07-06 20:59:00.641202397 +0000 UTC m=+36.170050179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-25wgq" (UID: "8c7a20d2-0d6c-42df-937a-7933d6a612ac") : secret "samples-operator-tls" not found Jul 06 20:59:00.141290 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-default-certificate\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:00.141784 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141288 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.141784 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141341 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtwhg\" (UniqueName: \"kubernetes.io/projected/3af73baf-4a83-4153-9a73-9b9b6674fc09-kube-api-access-qtwhg\") pod \"ingress-canary-rqt9r\" (UID: \"3af73baf-4a83-4153-9a73-9b9b6674fc09\") " pod="openshift-ingress-canary/ingress-canary-rqt9r" Jul 06 20:59:00.141784 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/819a8df1-a532-4fa1-8adc-5b55e8301925-ca-trust-extracted\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.141784 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141450 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trn8k\" (UniqueName: \"kubernetes.io/projected/16ffece4-6447-47d6-a16d-aafe0117f6e9-kube-api-access-trn8k\") pod \"insights-operator-5c847dcfc4-592fg\" (UID: \"16ffece4-6447-47d6-a16d-aafe0117f6e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.141784 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16ffece4-6447-47d6-a16d-aafe0117f6e9-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-592fg\" (UID: \"16ffece4-6447-47d6-a16d-aafe0117f6e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.141784 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.141542 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:59:00.141784 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/819a8df1-a532-4fa1-8adc-5b55e8301925-installation-pull-secrets\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.141784 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.141556 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687697f894-mgcsd: secret "image-registry-tls" not found Jul 06 20:59:00.141784 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141571 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a3f837b9-6181-468c-a74e-70d104adfdae-serving-cert\") pod \"console-operator-68b757fb67-z8vzb\" (UID: \"a3f837b9-6181-468c-a74e-70d104adfdae\") " pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" Jul 06 20:59:00.141784 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.141606 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls podName:819a8df1-a532-4fa1-8adc-5b55e8301925 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:00.641591693 +0000 UTC m=+36.170439471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls") pod "image-registry-687697f894-mgcsd" (UID: "819a8df1-a532-4fa1-8adc-5b55e8301925") : secret "image-registry-tls" not found Jul 06 20:59:00.141784 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141623 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ba87842f-c445-41bd-9656-bc4a83369b6b-config-volume\") pod \"dns-default-6r4bb\" (UID: \"ba87842f-c445-41bd-9656-bc4a83369b6b\") " pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:00.141784 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:00.141784 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/819a8df1-a532-4fa1-8adc-5b55e8301925-image-registry-private-configuration\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.141784 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141712 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/819a8df1-a532-4fa1-8adc-5b55e8301925-trusted-ca\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.141784 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141742 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f42135c2-6517-4bbf-a412-acb2e43c9b8c-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-slfss\" (UID: \"f42135c2-6517-4bbf-a412-acb2e43c9b8c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" Jul 06 20:59:00.141784 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141774 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebfdc233-cfa7-4ca5-95c2-9a0872c415c9-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-n6nxc\" (UID: \"ebfdc233-cfa7-4ca5-95c2-9a0872c415c9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc" Jul 06 20:59:00.142480 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141823 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-bound-sa-token\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.142480 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141852 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16ffece4-6447-47d6-a16d-aafe0117f6e9-tmp\") pod \"insights-operator-5c847dcfc4-592fg\" (UID: \"16ffece4-6447-47d6-a16d-aafe0117f6e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.142480 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141875 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79b1e6af-13f8-4946-ae15-78db17d10d04-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-xvqtl\" (UID: \"79b1e6af-13f8-4946-ae15-78db17d10d04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl" Jul 06 20:59:00.142480 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141912 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a3f837b9-6181-468c-a74e-70d104adfdae-config\") pod \"console-operator-68b757fb67-z8vzb\" (UID: \"a3f837b9-6181-468c-a74e-70d104adfdae\") " pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" Jul 06 20:59:00.142480 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141922 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrqs7\" (UniqueName: \"kubernetes.io/projected/5a68b42b-1cb7-4068-b285-59215061f0b1-kube-api-access-nrqs7\") pod \"network-check-source-989f8b8dc-jw6qp\" (UID: \"5a68b42b-1cb7-4068-b285-59215061f0b1\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jw6qp" Jul 06 20:59:00.142480 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebfdc233-cfa7-4ca5-95c2-9a0872c415c9-config\") pod \"service-ca-operator-5d46d9ffd4-n6nxc\" (UID: \"ebfdc233-cfa7-4ca5-95c2-9a0872c415c9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc" Jul 06 20:59:00.142480 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.141987 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79b1e6af-13f8-4946-ae15-78db17d10d04-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-xvqtl\" (UID: \"79b1e6af-13f8-4946-ae15-78db17d10d04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl" Jul 06 20:59:00.142480 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.142009 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls\") pod \"dns-default-6r4bb\" (UID: \"ba87842f-c445-41bd-9656-bc4a83369b6b\") " pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:00.142480 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.142036 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3af73baf-4a83-4153-9a73-9b9b6674fc09-cert\") pod \"ingress-canary-rqt9r\" (UID: \"3af73baf-4a83-4153-9a73-9b9b6674fc09\") " pod="openshift-ingress-canary/ingress-canary-rqt9r" Jul 06 20:59:00.142480 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.142061 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16ffece4-6447-47d6-a16d-aafe0117f6e9-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-592fg\" (UID: \"16ffece4-6447-47d6-a16d-aafe0117f6e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.142480 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.142087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htmxk\" (UniqueName: \"kubernetes.io/projected/8c7a20d2-0d6c-42df-937a-7933d6a612ac-kube-api-access-htmxk\") pod \"cluster-samples-operator-56fcf86bf-25wgq\" (UID: \"8c7a20d2-0d6c-42df-937a-7933d6a612ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq" Jul 06 20:59:00.142480 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.142113 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/16ffece4-6447-47d6-a16d-aafe0117f6e9-snapshots\") pod \"insights-operator-5c847dcfc4-592fg\" (UID: \"16ffece4-6447-47d6-a16d-aafe0117f6e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.143025 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.142114 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a3f837b9-6181-468c-a74e-70d104adfdae-trusted-ca\") pod \"console-operator-68b757fb67-z8vzb\" (UID: \"a3f837b9-6181-468c-a74e-70d104adfdae\") " pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" Jul 06 20:59:00.143128 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.143112 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 20:59:00.143404 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.143391 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs podName:a1772b59-30ba-434b-b201-19ab05b7f824 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:00.643372534 +0000 UTC m=+36.172220315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs") pod "router-default-7df99b5f7c-g9r85" (UID: "a1772b59-30ba-434b-b201-19ab05b7f824") : secret "router-metrics-certs-default" not found Jul 06 20:59:00.143717 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.143698 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/819a8df1-a532-4fa1-8adc-5b55e8301925-ca-trust-extracted\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.143811 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.143755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-slfss\" (UID: \"f42135c2-6517-4bbf-a412-acb2e43c9b8c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" Jul 06 20:59:00.143811 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.143792 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8zqh\" (UniqueName: \"kubernetes.io/projected/f42135c2-6517-4bbf-a412-acb2e43c9b8c-kube-api-access-s8zqh\") pod \"cluster-monitoring-operator-64786d9cbb-slfss\" (UID: \"f42135c2-6517-4bbf-a412-acb2e43c9b8c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" Jul 06 20:59:00.143908 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.143828 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-certificates\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.144011 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.143989 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16ffece4-6447-47d6-a16d-aafe0117f6e9-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-592fg\" (UID: \"16ffece4-6447-47d6-a16d-aafe0117f6e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.144400 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.144376 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-certificates\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.145867 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.145470 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ebfdc233-cfa7-4ca5-95c2-9a0872c415c9-config\") pod \"service-ca-operator-5d46d9ffd4-n6nxc\" (UID: \"ebfdc233-cfa7-4ca5-95c2-9a0872c415c9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc" Jul 06 20:59:00.146770 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.146260 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/819a8df1-a532-4fa1-8adc-5b55e8301925-trusted-ca\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.147234 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.147199 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-default-certificate\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:00.147324 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.147245 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f42135c2-6517-4bbf-a412-acb2e43c9b8c-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-slfss\" (UID: \"f42135c2-6517-4bbf-a412-acb2e43c9b8c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" Jul 06 20:59:00.148193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.147589 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16ffece4-6447-47d6-a16d-aafe0117f6e9-tmp\") pod \"insights-operator-5c847dcfc4-592fg\" (UID: \"16ffece4-6447-47d6-a16d-aafe0117f6e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.148193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.147595 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16ffece4-6447-47d6-a16d-aafe0117f6e9-serving-cert\") pod \"insights-operator-5c847dcfc4-592fg\" (UID: \"16ffece4-6447-47d6-a16d-aafe0117f6e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.148193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.147822 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/819a8df1-a532-4fa1-8adc-5b55e8301925-installation-pull-secrets\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.148193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.147953 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a3f837b9-6181-468c-a74e-70d104adfdae-serving-cert\") pod \"console-operator-68b757fb67-z8vzb\" (UID: \"a3f837b9-6181-468c-a74e-70d104adfdae\") " pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" Jul 06 20:59:00.148193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.147977 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/819a8df1-a532-4fa1-8adc-5b55e8301925-image-registry-private-configuration\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.148193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.147984 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-stats-auth\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:00.148560 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.148274 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 20:59:00.148560 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.148332 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls podName:f42135c2-6517-4bbf-a412-acb2e43c9b8c nodeName:}" failed. No retries permitted until 2026-07-06 20:59:00.648308453 +0000 UTC m=+36.177156232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-slfss" (UID: "f42135c2-6517-4bbf-a412-acb2e43c9b8c") : secret "cluster-monitoring-operator-tls" not found Jul 06 20:59:00.148560 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.148446 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/16ffece4-6447-47d6-a16d-aafe0117f6e9-snapshots\") pod \"insights-operator-5c847dcfc4-592fg\" (UID: \"16ffece4-6447-47d6-a16d-aafe0117f6e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.148560 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.148545 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79b1e6af-13f8-4946-ae15-78db17d10d04-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-xvqtl\" (UID: \"79b1e6af-13f8-4946-ae15-78db17d10d04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl" Jul 06 20:59:00.149000 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.148977 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16ffece4-6447-47d6-a16d-aafe0117f6e9-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-592fg\" (UID: \"16ffece4-6447-47d6-a16d-aafe0117f6e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.154522 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.152895 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ebfdc233-cfa7-4ca5-95c2-9a0872c415c9-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-n6nxc\" (UID: \"ebfdc233-cfa7-4ca5-95c2-9a0872c415c9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc" Jul 06 20:59:00.154522 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.153814 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79b1e6af-13f8-4946-ae15-78db17d10d04-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-xvqtl\" (UID: \"79b1e6af-13f8-4946-ae15-78db17d10d04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl" Jul 06 20:59:00.176629 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.176600 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n6zn\" (UniqueName: \"kubernetes.io/projected/a3f837b9-6181-468c-a74e-70d104adfdae-kube-api-access-5n6zn\") pod \"console-operator-68b757fb67-z8vzb\" (UID: \"a3f837b9-6181-468c-a74e-70d104adfdae\") " pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" Jul 06 20:59:00.177922 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.177905 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hlbp\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-kube-api-access-6hlbp\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.178234 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.178207 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqqcq\" (UniqueName: \"kubernetes.io/projected/79b1e6af-13f8-4946-ae15-78db17d10d04-kube-api-access-nqqcq\") pod \"kube-storage-version-migrator-operator-846bf668f7-xvqtl\" (UID: \"79b1e6af-13f8-4946-ae15-78db17d10d04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl" Jul 06 20:59:00.182458 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.182426 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2nkv\" (UniqueName: \"kubernetes.io/projected/ebfdc233-cfa7-4ca5-95c2-9a0872c415c9-kube-api-access-k2nkv\") pod \"service-ca-operator-5d46d9ffd4-n6nxc\" (UID: \"ebfdc233-cfa7-4ca5-95c2-9a0872c415c9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc" Jul 06 20:59:00.185652 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.185630 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-694pp\" (UniqueName: \"kubernetes.io/projected/a1772b59-30ba-434b-b201-19ab05b7f824-kube-api-access-694pp\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:00.185928 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.185906 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrqs7\" (UniqueName: \"kubernetes.io/projected/5a68b42b-1cb7-4068-b285-59215061f0b1-kube-api-access-nrqs7\") pod \"network-check-source-989f8b8dc-jw6qp\" (UID: \"5a68b42b-1cb7-4068-b285-59215061f0b1\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jw6qp" Jul 06 20:59:00.186011 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.185908 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trn8k\" (UniqueName: \"kubernetes.io/projected/16ffece4-6447-47d6-a16d-aafe0117f6e9-kube-api-access-trn8k\") pod \"insights-operator-5c847dcfc4-592fg\" (UID: \"16ffece4-6447-47d6-a16d-aafe0117f6e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.186144 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.186127 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpjrs\" (UniqueName: \"kubernetes.io/projected/ecb7d917-0d0b-47a6-8756-d579096a6c11-kube-api-access-rpjrs\") pod \"volume-data-source-validator-5d456fdbcd-s7bvx\" (UID: \"ecb7d917-0d0b-47a6-8756-d579096a6c11\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-s7bvx" Jul 06 20:59:00.188936 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.188916 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-bound-sa-token\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.189765 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.189706 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htmxk\" (UniqueName: \"kubernetes.io/projected/8c7a20d2-0d6c-42df-937a-7933d6a612ac-kube-api-access-htmxk\") pod \"cluster-samples-operator-56fcf86bf-25wgq\" (UID: \"8c7a20d2-0d6c-42df-937a-7933d6a612ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq" Jul 06 20:59:00.191252 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.191232 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8zqh\" (UniqueName: \"kubernetes.io/projected/f42135c2-6517-4bbf-a412-acb2e43c9b8c-kube-api-access-s8zqh\") pod \"cluster-monitoring-operator-64786d9cbb-slfss\" (UID: \"f42135c2-6517-4bbf-a412-acb2e43c9b8c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" Jul 06 20:59:00.195066 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.195044 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl" Jul 06 20:59:00.215898 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.215872 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-592fg" Jul 06 20:59:00.223996 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.223965 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-s7bvx" Jul 06 20:59:00.244936 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.244894 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtwhg\" (UniqueName: \"kubernetes.io/projected/3af73baf-4a83-4153-9a73-9b9b6674fc09-kube-api-access-qtwhg\") pod \"ingress-canary-rqt9r\" (UID: \"3af73baf-4a83-4153-9a73-9b9b6674fc09\") " pod="openshift-ingress-canary/ingress-canary-rqt9r" Jul 06 20:59:00.245108 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.244974 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ba87842f-c445-41bd-9656-bc4a83369b6b-config-volume\") pod \"dns-default-6r4bb\" (UID: \"ba87842f-c445-41bd-9656-bc4a83369b6b\") " pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:00.245108 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.245023 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" Jul 06 20:59:00.245108 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.245055 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls\") pod \"dns-default-6r4bb\" (UID: \"ba87842f-c445-41bd-9656-bc4a83369b6b\") " pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:00.245108 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.245083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3af73baf-4a83-4153-9a73-9b9b6674fc09-cert\") pod \"ingress-canary-rqt9r\" (UID: \"3af73baf-4a83-4153-9a73-9b9b6674fc09\") " pod="openshift-ingress-canary/ingress-canary-rqt9r" Jul 06 20:59:00.245317 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.245127 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6t99\" (UniqueName: \"kubernetes.io/projected/ba87842f-c445-41bd-9656-bc4a83369b6b-kube-api-access-g6t99\") pod \"dns-default-6r4bb\" (UID: \"ba87842f-c445-41bd-9656-bc4a83369b6b\") " pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:00.245317 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.245158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba87842f-c445-41bd-9656-bc4a83369b6b-tmp-dir\") pod \"dns-default-6r4bb\" (UID: \"ba87842f-c445-41bd-9656-bc4a83369b6b\") " pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:00.245880 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.245532 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:59:00.245880 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.245588 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba87842f-c445-41bd-9656-bc4a83369b6b-tmp-dir\") pod \"dns-default-6r4bb\" (UID: \"ba87842f-c445-41bd-9656-bc4a83369b6b\") " pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:00.245880 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.245689 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls podName:ba87842f-c445-41bd-9656-bc4a83369b6b nodeName:}" failed. No retries permitted until 2026-07-06 20:59:00.745645152 +0000 UTC m=+36.274492930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls") pod "dns-default-6r4bb" (UID: "ba87842f-c445-41bd-9656-bc4a83369b6b") : secret "dns-default-metrics-tls" not found Jul 06 20:59:00.247049 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.247018 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ba87842f-c445-41bd-9656-bc4a83369b6b-config-volume\") pod \"dns-default-6r4bb\" (UID: \"ba87842f-c445-41bd-9656-bc4a83369b6b\") " pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:00.249266 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.249217 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3af73baf-4a83-4153-9a73-9b9b6674fc09-cert\") pod \"ingress-canary-rqt9r\" (UID: \"3af73baf-4a83-4153-9a73-9b9b6674fc09\") " pod="openshift-ingress-canary/ingress-canary-rqt9r" Jul 06 20:59:00.260012 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.259950 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jw6qp" Jul 06 20:59:00.263624 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.263595 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtwhg\" (UniqueName: \"kubernetes.io/projected/3af73baf-4a83-4153-9a73-9b9b6674fc09-kube-api-access-qtwhg\") pod \"ingress-canary-rqt9r\" (UID: \"3af73baf-4a83-4153-9a73-9b9b6674fc09\") " pod="openshift-ingress-canary/ingress-canary-rqt9r" Jul 06 20:59:00.266549 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.266211 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6t99\" (UniqueName: \"kubernetes.io/projected/ba87842f-c445-41bd-9656-bc4a83369b6b-kube-api-access-g6t99\") pod \"dns-default-6r4bb\" (UID: \"ba87842f-c445-41bd-9656-bc4a83369b6b\") " pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:00.266549 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.266333 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc" Jul 06 20:59:00.293516 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.293465 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:00.297859 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.297577 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rqt9r" Jul 06 20:59:00.412221 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.411239 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:00.432895 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.432788 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl"] Jul 06 20:59:00.452596 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:59:00.452543 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b1e6af_13f8_4946_ae15_78db17d10d04.slice/crio-cae67d1f71cf874d4d553ecb2d93d298dffebcacf3cbee3d4d768f0e0d5e0ccb WatchSource:0}: Error finding container cae67d1f71cf874d4d553ecb2d93d298dffebcacf3cbee3d4d768f0e0d5e0ccb: Status 404 returned error can't find the container with id cae67d1f71cf874d4d553ecb2d93d298dffebcacf3cbee3d4d768f0e0d5e0ccb Jul 06 20:59:00.479830 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.479304 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-592fg"] Jul 06 20:59:00.484483 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:59:00.484448 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ffece4_6447_47d6_a16d_aafe0117f6e9.slice/crio-dabd8e8cf98a260950fcb25456079275543a15378e042a10659a0d1ac9b3ef0e WatchSource:0}: Error finding container dabd8e8cf98a260950fcb25456079275543a15378e042a10659a0d1ac9b3ef0e: Status 404 returned error can't find the container with id dabd8e8cf98a260950fcb25456079275543a15378e042a10659a0d1ac9b3ef0e Jul 06 20:59:00.486750 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.484988 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:00.496158 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.496086 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-s7bvx"] Jul 06 20:59:00.502081 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:59:00.502050 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb7d917_0d0b_47a6_8756_d579096a6c11.slice/crio-74458c1c8b48ddf7b2ae9b26a33a6aa90f0611a2c7ecabd9486fc75d8fa81446 WatchSource:0}: Error finding container 74458c1c8b48ddf7b2ae9b26a33a6aa90f0611a2c7ecabd9486fc75d8fa81446: Status 404 returned error can't find the container with id 74458c1c8b48ddf7b2ae9b26a33a6aa90f0611a2c7ecabd9486fc75d8fa81446 Jul 06 20:59:00.505850 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.505795 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-z8vzb"] Jul 06 20:59:00.508588 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:59:00.508543 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f837b9_6181_468c_a74e_70d104adfdae.slice/crio-901e3c231e4c4de6b5945de49aae791573bd92157d4947ffa8523c2dfa51c691 WatchSource:0}: Error finding container 901e3c231e4c4de6b5945de49aae791573bd92157d4947ffa8523c2dfa51c691: Status 404 returned error can't find the container with id 901e3c231e4c4de6b5945de49aae791573bd92157d4947ffa8523c2dfa51c691 Jul 06 20:59:00.537092 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.537060 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-jw6qp"] Jul 06 20:59:00.540462 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:59:00.540438 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a68b42b_1cb7_4068_b285_59215061f0b1.slice/crio-7f73b3b692891b70ae85826cb1a6f54cc22905d13a0553d5e3f366d4a1857d96 WatchSource:0}: Error finding container 7f73b3b692891b70ae85826cb1a6f54cc22905d13a0553d5e3f366d4a1857d96: Status 404 returned error can't find the container with id 7f73b3b692891b70ae85826cb1a6f54cc22905d13a0553d5e3f366d4a1857d96 Jul 06 20:59:00.544444 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.544277 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc"] Jul 06 20:59:00.546832 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:59:00.546811 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebfdc233_cfa7_4ca5_95c2_9a0872c415c9.slice/crio-05ec26066c6a8fbd88cc2466e8ff52500ce5ce7496ec9c371929de03bb76e23f WatchSource:0}: Error finding container 05ec26066c6a8fbd88cc2466e8ff52500ce5ce7496ec9c371929de03bb76e23f: Status 404 returned error can't find the container with id 05ec26066c6a8fbd88cc2466e8ff52500ce5ce7496ec9c371929de03bb76e23f Jul 06 20:59:00.549077 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.549055 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rqt9r"] Jul 06 20:59:00.552537 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:59:00.552463 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3af73baf_4a83_4153_9a73_9b9b6674fc09.slice/crio-4cb9a0f4f7325d6a6177d02b42ca71a4b305ddb081e002e82bd63b118905a320 WatchSource:0}: Error finding container 4cb9a0f4f7325d6a6177d02b42ca71a4b305ddb081e002e82bd63b118905a320: Status 404 returned error can't find the container with id 4cb9a0f4f7325d6a6177d02b42ca71a4b305ddb081e002e82bd63b118905a320 Jul 06 20:59:00.558594 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.558573 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:00.625794 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.625755 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:00.650244 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.650166 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-slfss\" (UID: \"f42135c2-6517-4bbf-a412-acb2e43c9b8c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" Jul 06 20:59:00.650244 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.650220 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:00.650450 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.650327 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle podName:a1772b59-30ba-434b-b201-19ab05b7f824 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:01.650312526 +0000 UTC m=+37.179160322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle") pod "router-default-7df99b5f7c-g9r85" (UID: "a1772b59-30ba-434b-b201-19ab05b7f824") : configmap references non-existent config key: service-ca.crt Jul 06 20:59:00.650450 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.650328 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 20:59:00.650450 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.650357 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-25wgq\" (UID: \"8c7a20d2-0d6c-42df-937a-7933d6a612ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq" Jul 06 20:59:00.650450 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.650366 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls podName:f42135c2-6517-4bbf-a412-acb2e43c9b8c nodeName:}" failed. No retries permitted until 2026-07-06 20:59:01.650357734 +0000 UTC m=+37.179205511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-slfss" (UID: "f42135c2-6517-4bbf-a412-acb2e43c9b8c") : secret "cluster-monitoring-operator-tls" not found Jul 06 20:59:00.650450 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.650434 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:00.650704 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.650464 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 20:59:00.650704 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.650493 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:00.650704 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.650546 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls podName:8c7a20d2-0d6c-42df-937a-7933d6a612ac nodeName:}" failed. No retries permitted until 2026-07-06 20:59:01.650493779 +0000 UTC m=+37.179341556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-25wgq" (UID: "8c7a20d2-0d6c-42df-937a-7933d6a612ac") : secret "samples-operator-tls" not found Jul 06 20:59:00.650704 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.650586 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 20:59:00.650704 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.650594 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:59:00.650704 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.650614 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687697f894-mgcsd: secret "image-registry-tls" not found Jul 06 20:59:00.650704 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.650637 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs podName:a1772b59-30ba-434b-b201-19ab05b7f824 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:01.650621809 +0000 UTC m=+37.179469590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs") pod "router-default-7df99b5f7c-g9r85" (UID: "a1772b59-30ba-434b-b201-19ab05b7f824") : secret "router-metrics-certs-default" not found Jul 06 20:59:00.650704 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.650655 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls podName:819a8df1-a532-4fa1-8adc-5b55e8301925 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:01.650644126 +0000 UTC m=+37.179491909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls") pod "image-registry-687697f894-mgcsd" (UID: "819a8df1-a532-4fa1-8adc-5b55e8301925") : secret "image-registry-tls" not found Jul 06 20:59:00.751472 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:00.751433 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls\") pod \"dns-default-6r4bb\" (UID: \"ba87842f-c445-41bd-9656-bc4a83369b6b\") " pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:00.751640 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.751595 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:59:00.751677 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:00.751655 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls podName:ba87842f-c445-41bd-9656-bc4a83369b6b nodeName:}" failed. No retries permitted until 2026-07-06 20:59:01.751640599 +0000 UTC m=+37.280488379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls") pod "dns-default-6r4bb" (UID: "ba87842f-c445-41bd-9656-bc4a83369b6b") : secret "dns-default-metrics-tls" not found Jul 06 20:59:01.237130 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:01.237090 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rqt9r" event={"ID":"3af73baf-4a83-4153-9a73-9b9b6674fc09","Type":"ContainerStarted","Data":"4cb9a0f4f7325d6a6177d02b42ca71a4b305ddb081e002e82bd63b118905a320"} Jul 06 20:59:01.239808 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:01.239745 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc" event={"ID":"ebfdc233-cfa7-4ca5-95c2-9a0872c415c9","Type":"ContainerStarted","Data":"05ec26066c6a8fbd88cc2466e8ff52500ce5ce7496ec9c371929de03bb76e23f"} Jul 06 20:59:01.241547 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:01.241418 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-592fg" event={"ID":"16ffece4-6447-47d6-a16d-aafe0117f6e9","Type":"ContainerStarted","Data":"dabd8e8cf98a260950fcb25456079275543a15378e042a10659a0d1ac9b3ef0e"} Jul 06 20:59:01.243748 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:01.243724 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl" event={"ID":"79b1e6af-13f8-4946-ae15-78db17d10d04","Type":"ContainerStarted","Data":"cae67d1f71cf874d4d553ecb2d93d298dffebcacf3cbee3d4d768f0e0d5e0ccb"} Jul 06 20:59:01.247557 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:01.247531 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jw6qp" event={"ID":"5a68b42b-1cb7-4068-b285-59215061f0b1","Type":"ContainerStarted","Data":"7f73b3b692891b70ae85826cb1a6f54cc22905d13a0553d5e3f366d4a1857d96"} Jul 06 20:59:01.249578 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:01.249527 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" event={"ID":"a3f837b9-6181-468c-a74e-70d104adfdae","Type":"ContainerStarted","Data":"901e3c231e4c4de6b5945de49aae791573bd92157d4947ffa8523c2dfa51c691"} Jul 06 20:59:01.251267 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:01.251241 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-s7bvx" event={"ID":"ecb7d917-0d0b-47a6-8756-d579096a6c11","Type":"ContainerStarted","Data":"74458c1c8b48ddf7b2ae9b26a33a6aa90f0611a2c7ecabd9486fc75d8fa81446"} Jul 06 20:59:01.665189 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:01.663930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-25wgq\" (UID: \"8c7a20d2-0d6c-42df-937a-7933d6a612ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq" Jul 06 20:59:01.665189 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:01.664005 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:01.665189 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:01.664064 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:01.665189 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:01.664139 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-slfss\" (UID: \"f42135c2-6517-4bbf-a412-acb2e43c9b8c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" Jul 06 20:59:01.665189 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:01.664187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:01.665189 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:01.664341 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle podName:a1772b59-30ba-434b-b201-19ab05b7f824 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:03.664321576 +0000 UTC m=+39.193169358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle") pod "router-default-7df99b5f7c-g9r85" (UID: "a1772b59-30ba-434b-b201-19ab05b7f824") : configmap references non-existent config key: service-ca.crt Jul 06 20:59:01.665189 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:01.664831 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 20:59:01.665189 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:01.664884 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls podName:8c7a20d2-0d6c-42df-937a-7933d6a612ac nodeName:}" failed. No retries permitted until 2026-07-06 20:59:03.664866381 +0000 UTC m=+39.193714164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-25wgq" (UID: "8c7a20d2-0d6c-42df-937a-7933d6a612ac") : secret "samples-operator-tls" not found Jul 06 20:59:01.665189 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:01.664950 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:59:01.665189 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:01.664962 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687697f894-mgcsd: secret "image-registry-tls" not found Jul 06 20:59:01.665189 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:01.664994 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls podName:819a8df1-a532-4fa1-8adc-5b55e8301925 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:03.664982182 +0000 UTC m=+39.193829964 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls") pod "image-registry-687697f894-mgcsd" (UID: "819a8df1-a532-4fa1-8adc-5b55e8301925") : secret "image-registry-tls" not found Jul 06 20:59:01.665189 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:01.665046 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 20:59:01.665189 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:01.665074 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs podName:a1772b59-30ba-434b-b201-19ab05b7f824 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:03.6650643 +0000 UTC m=+39.193912082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs") pod "router-default-7df99b5f7c-g9r85" (UID: "a1772b59-30ba-434b-b201-19ab05b7f824") : secret "router-metrics-certs-default" not found Jul 06 20:59:01.665189 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:01.665122 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 20:59:01.665189 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:01.665152 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls podName:f42135c2-6517-4bbf-a412-acb2e43c9b8c nodeName:}" failed. No retries permitted until 2026-07-06 20:59:03.665142121 +0000 UTC m=+39.193989900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-slfss" (UID: "f42135c2-6517-4bbf-a412-acb2e43c9b8c") : secret "cluster-monitoring-operator-tls" not found Jul 06 20:59:01.766304 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:01.765673 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls\") pod \"dns-default-6r4bb\" (UID: \"ba87842f-c445-41bd-9656-bc4a83369b6b\") " pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:01.766304 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:01.765895 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:59:01.766304 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:01.765960 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls podName:ba87842f-c445-41bd-9656-bc4a83369b6b nodeName:}" failed. No retries permitted until 2026-07-06 20:59:03.765941075 +0000 UTC m=+39.294788855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls") pod "dns-default-6r4bb" (UID: "ba87842f-c445-41bd-9656-bc4a83369b6b") : secret "dns-default-metrics-tls" not found Jul 06 20:59:02.157618 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:02.157520 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:02.260649 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:02.260613 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:02.358515 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:02.358467 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:03.128361 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:03.128090 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:03.223676 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:03.223605 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:03.279355 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:03.279322 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:03.683848 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:03.683607 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-slfss\" (UID: \"f42135c2-6517-4bbf-a412-acb2e43c9b8c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" Jul 06 20:59:03.683848 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:03.683655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:03.683848 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:03.683676 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-25wgq\" (UID: \"8c7a20d2-0d6c-42df-937a-7933d6a612ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq" Jul 06 20:59:03.683848 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:03.683714 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:03.683848 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:03.683771 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:03.683848 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:03.683782 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 20:59:03.683848 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:03.683816 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 20:59:03.683848 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:03.683830 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle podName:a1772b59-30ba-434b-b201-19ab05b7f824 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:07.683808637 +0000 UTC m=+43.212656419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle") pod "router-default-7df99b5f7c-g9r85" (UID: "a1772b59-30ba-434b-b201-19ab05b7f824") : configmap references non-existent config key: service-ca.crt Jul 06 20:59:03.683848 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:03.683852 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls podName:f42135c2-6517-4bbf-a412-acb2e43c9b8c nodeName:}" failed. No retries permitted until 2026-07-06 20:59:07.683842096 +0000 UTC m=+43.212689872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-slfss" (UID: "f42135c2-6517-4bbf-a412-acb2e43c9b8c") : secret "cluster-monitoring-operator-tls" not found Jul 06 20:59:03.684525 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:03.683863 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 20:59:03.684525 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:03.683869 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls podName:8c7a20d2-0d6c-42df-937a-7933d6a612ac nodeName:}" failed. No retries permitted until 2026-07-06 20:59:07.683857875 +0000 UTC m=+43.212705693 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-25wgq" (UID: "8c7a20d2-0d6c-42df-937a-7933d6a612ac") : secret "samples-operator-tls" not found Jul 06 20:59:03.684525 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:03.683887 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:59:03.684525 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:03.683897 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687697f894-mgcsd: secret "image-registry-tls" not found Jul 06 20:59:03.684525 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:03.683906 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs podName:a1772b59-30ba-434b-b201-19ab05b7f824 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:07.68389062 +0000 UTC m=+43.212738406 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs") pod "router-default-7df99b5f7c-g9r85" (UID: "a1772b59-30ba-434b-b201-19ab05b7f824") : secret "router-metrics-certs-default" not found Jul 06 20:59:03.684525 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:03.683924 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls podName:819a8df1-a532-4fa1-8adc-5b55e8301925 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:07.683912719 +0000 UTC m=+43.212760495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls") pod "image-registry-687697f894-mgcsd" (UID: "819a8df1-a532-4fa1-8adc-5b55e8301925") : secret "image-registry-tls" not found Jul 06 20:59:03.785054 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:03.785016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls\") pod \"dns-default-6r4bb\" (UID: \"ba87842f-c445-41bd-9656-bc4a83369b6b\") " pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:03.785232 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:03.785181 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:59:03.785286 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:03.785245 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls podName:ba87842f-c445-41bd-9656-bc4a83369b6b nodeName:}" failed. No retries permitted until 2026-07-06 20:59:07.785228921 +0000 UTC m=+43.314076714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls") pod "dns-default-6r4bb" (UID: "ba87842f-c445-41bd-9656-bc4a83369b6b") : secret "dns-default-metrics-tls" not found Jul 06 20:59:04.392037 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:04.391954 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:05.257398 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:05.257360 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:05.465737 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:05.465684 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:05.566405 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:05.566370 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:07.722719 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:07.722682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:07.723277 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:07.722785 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-slfss\" (UID: \"f42135c2-6517-4bbf-a412-acb2e43c9b8c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" Jul 06 20:59:07.723277 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:07.722843 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:07.723277 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:07.722861 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 20:59:07.723277 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:07.722874 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-25wgq\" (UID: \"8c7a20d2-0d6c-42df-937a-7933d6a612ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq" Jul 06 20:59:07.723277 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:07.722926 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs podName:a1772b59-30ba-434b-b201-19ab05b7f824 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:15.722907123 +0000 UTC m=+51.251754924 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs") pod "router-default-7df99b5f7c-g9r85" (UID: "a1772b59-30ba-434b-b201-19ab05b7f824") : secret "router-metrics-certs-default" not found Jul 06 20:59:07.723277 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:07.722946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:07.723277 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:07.722969 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 20:59:07.723277 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:07.723003 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls podName:8c7a20d2-0d6c-42df-937a-7933d6a612ac nodeName:}" failed. No retries permitted until 2026-07-06 20:59:15.722993027 +0000 UTC m=+51.251840806 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-25wgq" (UID: "8c7a20d2-0d6c-42df-937a-7933d6a612ac") : secret "samples-operator-tls" not found Jul 06 20:59:07.723277 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:07.723052 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:59:07.723277 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:07.723064 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687697f894-mgcsd: secret "image-registry-tls" not found Jul 06 20:59:07.723277 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:07.723095 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls podName:819a8df1-a532-4fa1-8adc-5b55e8301925 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:15.723084747 +0000 UTC m=+51.251932527 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls") pod "image-registry-687697f894-mgcsd" (UID: "819a8df1-a532-4fa1-8adc-5b55e8301925") : secret "image-registry-tls" not found Jul 06 20:59:07.723277 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:07.723053 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 20:59:07.723277 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:07.723110 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle podName:a1772b59-30ba-434b-b201-19ab05b7f824 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:15.723100823 +0000 UTC m=+51.251948618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle") pod "router-default-7df99b5f7c-g9r85" (UID: "a1772b59-30ba-434b-b201-19ab05b7f824") : configmap references non-existent config key: service-ca.crt Jul 06 20:59:07.723277 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:07.723127 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls podName:f42135c2-6517-4bbf-a412-acb2e43c9b8c nodeName:}" failed. No retries permitted until 2026-07-06 20:59:15.723119121 +0000 UTC m=+51.251966898 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-slfss" (UID: "f42135c2-6517-4bbf-a412-acb2e43c9b8c") : secret "cluster-monitoring-operator-tls" not found Jul 06 20:59:07.824086 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:07.824045 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls\") pod \"dns-default-6r4bb\" (UID: \"ba87842f-c445-41bd-9656-bc4a83369b6b\") " pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:07.824261 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:07.824206 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:59:07.824324 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:07.824277 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls podName:ba87842f-c445-41bd-9656-bc4a83369b6b nodeName:}" failed. No retries permitted until 2026-07-06 20:59:15.824258532 +0000 UTC m=+51.353106316 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls") pod "dns-default-6r4bb" (UID: "ba87842f-c445-41bd-9656-bc4a83369b6b") : secret "dns-default-metrics-tls" not found Jul 06 20:59:10.288792 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:10.288757 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rqt9r" event={"ID":"3af73baf-4a83-4153-9a73-9b9b6674fc09","Type":"ContainerStarted","Data":"8d3916e84da702f9fc8812e8eb7947bbbdcd405716a656c7529d44f0866bce7a"} Jul 06 20:59:10.291478 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:10.291448 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc" event={"ID":"ebfdc233-cfa7-4ca5-95c2-9a0872c415c9","Type":"ContainerStarted","Data":"bd7151e0de33de5c5e6b90e47182960e3bbd53cd8c5cacd3920cdde719a14b38"} Jul 06 20:59:10.293389 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:10.293330 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-592fg" event={"ID":"16ffece4-6447-47d6-a16d-aafe0117f6e9","Type":"ContainerStarted","Data":"eaba70f69c0f94f17aaa08adecb5766a4321c360a3542966df50d696aad0a71d"} Jul 06 20:59:10.297017 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:10.296957 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl" event={"ID":"79b1e6af-13f8-4946-ae15-78db17d10d04","Type":"ContainerStarted","Data":"92ee143e86f93ae27f384879a05505e43e2cf152f1591cde6bf634124f2ea2a9"} Jul 06 20:59:10.299361 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:10.299343 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/0.log" Jul 06 20:59:10.299541 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:10.299520 2564 generic.go:356] "Generic (PLEG): container finished" podID="a3f837b9-6181-468c-a74e-70d104adfdae" containerID="a550d501f2151dea7d4108fd0121bb912843a064dafa030954618e8ed72e5da6" exitCode=255 Jul 06 20:59:10.299700 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:10.299551 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" event={"ID":"a3f837b9-6181-468c-a74e-70d104adfdae","Type":"ContainerDied","Data":"a550d501f2151dea7d4108fd0121bb912843a064dafa030954618e8ed72e5da6"} Jul 06 20:59:10.299844 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:10.299808 2564 scope.go:117] "RemoveContainer" containerID="a550d501f2151dea7d4108fd0121bb912843a064dafa030954618e8ed72e5da6" Jul 06 20:59:10.302131 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:10.302108 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-s7bvx" event={"ID":"ecb7d917-0d0b-47a6-8756-d579096a6c11","Type":"ContainerStarted","Data":"a0ad61d396f8cd3bff1667d566103270a0324c2f07b8f95b6b90d157b647af8b"} Jul 06 20:59:10.321850 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:10.319622 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rqt9r" podStartSLOduration=1.870583732 podStartE2EDuration="11.319602626s" totalImagesPullingTime="9.449018894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:10.31823559 +0000 UTC m=+45.847083390" watchObservedRunningTime="2026-07-06 20:59:10.319602626 +0000 UTC m=+45.848450417" Jul 06 20:59:10.344041 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:10.343992 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl" podStartSLOduration=11.796247523 podStartE2EDuration="21.343972469s" totalImagesPullingTime="9.547724946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:10.343483626 +0000 UTC m=+45.872331427" watchObservedRunningTime="2026-07-06 20:59:10.343972469 +0000 UTC m=+45.872820272" Jul 06 20:59:10.376125 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:10.376067 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc" podStartSLOduration=11.923084746 podStartE2EDuration="21.376009353s" totalImagesPullingTime="9.452924607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:10.374152749 +0000 UTC m=+45.903000549" watchObservedRunningTime="2026-07-06 20:59:10.376009353 +0000 UTC m=+45.904857134" Jul 06 20:59:10.408845 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:10.407132 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-592fg" podStartSLOduration=10.895204664 podStartE2EDuration="20.407112568s" totalImagesPullingTime="9.511907904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:10.406854859 +0000 UTC m=+45.935702659" watchObservedRunningTime="2026-07-06 20:59:10.407112568 +0000 UTC m=+45.935960362" Jul 06 20:59:10.459582 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:10.456296 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-s7bvx" podStartSLOduration=12.728376745 podStartE2EDuration="20.45627564s" totalImagesPullingTime="7.727898895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:10.430667382 +0000 UTC m=+45.959515183" watchObservedRunningTime="2026-07-06 20:59:10.45627564 +0000 UTC m=+45.985123441" Jul 06 20:59:10.530803 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:10.530775 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:10.636061 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:10.636023 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:11.308574 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.308115 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jw6qp" event={"ID":"5a68b42b-1cb7-4068-b285-59215061f0b1","Type":"ContainerStarted","Data":"4397a4932aa20e86cfb45388a67dbaaf8bdd84657186613f088bb9b1bfba59a9"} Jul 06 20:59:11.309840 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.309818 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 20:59:11.311313 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.310347 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/0.log" Jul 06 20:59:11.311313 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.310383 2564 generic.go:356] "Generic (PLEG): container finished" podID="a3f837b9-6181-468c-a74e-70d104adfdae" containerID="ac26d92eb10a1d3ff456d506d0a3122e483fd0b3fda7757651d41229de9e46ad" exitCode=255 Jul 06 20:59:11.311313 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.310759 2564 scope.go:117] "RemoveContainer" containerID="ac26d92eb10a1d3ff456d506d0a3122e483fd0b3fda7757651d41229de9e46ad" Jul 06 20:59:11.311313 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:11.310920 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-z8vzb_openshift-console-operator(a3f837b9-6181-468c-a74e-70d104adfdae)\"" pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" podUID="a3f837b9-6181-468c-a74e-70d104adfdae" Jul 06 20:59:11.311313 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.311142 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" event={"ID":"a3f837b9-6181-468c-a74e-70d104adfdae","Type":"ContainerDied","Data":"ac26d92eb10a1d3ff456d506d0a3122e483fd0b3fda7757651d41229de9e46ad"} Jul 06 20:59:11.311313 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.311193 2564 scope.go:117] "RemoveContainer" containerID="a550d501f2151dea7d4108fd0121bb912843a064dafa030954618e8ed72e5da6" Jul 06 20:59:11.316168 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.316146 2564 generic.go:356] "Generic (PLEG): container finished" podID="ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d" containerID="3e066b9b1fb2ab35d096944e4f3e594ff0eb857001f21f7c65a9d3b87307dcbc" exitCode=0 Jul 06 20:59:11.316272 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.316241 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hwpl" event={"ID":"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d","Type":"ContainerDied","Data":"3e066b9b1fb2ab35d096944e4f3e594ff0eb857001f21f7c65a9d3b87307dcbc"} Jul 06 20:59:11.327286 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.327232 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jw6qp" podStartSLOduration=9.854945638 podStartE2EDuration="19.327215888s" totalImagesPullingTime="9.47227025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:11.32720284 +0000 UTC m=+46.856050639" watchObservedRunningTime="2026-07-06 20:59:11.327215888 +0000 UTC m=+46.856063687" Jul 06 20:59:11.393517 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.393222 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wt5zj"] Jul 06 20:59:11.424579 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.424208 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:11.425286 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.425262 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wt5zj"] Jul 06 20:59:11.425391 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.425382 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:11.428294 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.428275 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 20:59:11.428537 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.428522 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-85slc\"" Jul 06 20:59:11.429487 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.429469 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 20:59:11.459570 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.459546 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m4sg\" (UniqueName: \"kubernetes.io/projected/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-kube-api-access-6m4sg\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:11.459673 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.459637 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:11.459780 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.459668 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-data-volume\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:11.459832 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.459785 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:11.459881 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.459849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-crio-socket\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:11.512942 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.512891 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:11.560420 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.560389 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:11.560541 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.560452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-data-volume\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:11.560541 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:11.560479 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:59:11.560648 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:11.560574 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-kube-rbac-proxy-cm podName:1b83685a-6ba3-4f56-bc18-9d5818ca8af5 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:12.060553633 +0000 UTC m=+47.589401412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wt5zj" (UID: "1b83685a-6ba3-4f56-bc18-9d5818ca8af5") : configmap "kube-rbac-proxy" not found Jul 06 20:59:11.560805 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.560787 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-data-volume\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:11.560921 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.560903 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:11.560973 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.560962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-crio-socket\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:11.561020 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:11.560988 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:59:11.561067 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:11.561037 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-insights-runtime-extractor-tls podName:1b83685a-6ba3-4f56-bc18-9d5818ca8af5 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:12.061021817 +0000 UTC m=+47.589869612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wt5zj" (UID: "1b83685a-6ba3-4f56-bc18-9d5818ca8af5") : secret "insights-runtime-extractor-tls" not found Jul 06 20:59:11.561123 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.561079 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-crio-socket\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:11.561123 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.561097 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m4sg\" (UniqueName: \"kubernetes.io/projected/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-kube-api-access-6m4sg\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:11.576658 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.576637 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m4sg\" (UniqueName: \"kubernetes.io/projected/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-kube-api-access-6m4sg\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:11.704376 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.704323 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:11.807842 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.807809 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:11.910634 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:11.910559 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:12.006687 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:12.006652 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:12.065722 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:12.065684 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:12.065888 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:12.065759 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:12.065888 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:12.065838 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:59:12.065950 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:12.065919 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-kube-rbac-proxy-cm podName:1b83685a-6ba3-4f56-bc18-9d5818ca8af5 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:13.065900025 +0000 UTC m=+48.594747805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wt5zj" (UID: "1b83685a-6ba3-4f56-bc18-9d5818ca8af5") : configmap "kube-rbac-proxy" not found Jul 06 20:59:12.065950 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:12.065929 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:59:12.066032 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:12.065974 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-insights-runtime-extractor-tls podName:1b83685a-6ba3-4f56-bc18-9d5818ca8af5 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:13.065958731 +0000 UTC m=+48.594806508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wt5zj" (UID: "1b83685a-6ba3-4f56-bc18-9d5818ca8af5") : secret "insights-runtime-extractor-tls" not found Jul 06 20:59:12.081955 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:12.081922 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:12.136146 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:12.136120 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:12.323173 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:12.323142 2564 generic.go:356] "Generic (PLEG): container finished" podID="ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d" containerID="df0afeb3ba6d1acc123cf7f9b1c5060d032eb6d426b1e7ea41ffbdec9b4155d3" exitCode=0 Jul 06 20:59:12.323598 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:12.323225 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hwpl" event={"ID":"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d","Type":"ContainerDied","Data":"df0afeb3ba6d1acc123cf7f9b1c5060d032eb6d426b1e7ea41ffbdec9b4155d3"} Jul 06 20:59:12.324785 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:12.324766 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 20:59:12.325034 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:12.325016 2564 scope.go:117] "RemoveContainer" containerID="ac26d92eb10a1d3ff456d506d0a3122e483fd0b3fda7757651d41229de9e46ad" Jul 06 20:59:12.325182 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:12.325164 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-z8vzb_openshift-console-operator(a3f837b9-6181-468c-a74e-70d104adfdae)\"" pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" podUID="a3f837b9-6181-468c-a74e-70d104adfdae" Jul 06 20:59:12.568643 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:12.568615 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cf2gt_0baf1d79-4121-4204-930a-08a0ada71541/dns-node-resolver/0.log" Jul 06 20:59:12.568789 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:12.568651 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:12.619407 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:12.619330 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:12.839354 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:12.839326 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:12.940244 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:12.940169 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:13.074451 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:13.074416 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:13.074631 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:13.074476 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:13.074631 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:13.074553 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:59:13.074631 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:13.074579 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:59:13.074631 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:13.074621 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-kube-rbac-proxy-cm podName:1b83685a-6ba3-4f56-bc18-9d5818ca8af5 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:15.074603644 +0000 UTC m=+50.603451421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wt5zj" (UID: "1b83685a-6ba3-4f56-bc18-9d5818ca8af5") : configmap "kube-rbac-proxy" not found Jul 06 20:59:13.074631 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:13.074634 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-insights-runtime-extractor-tls podName:1b83685a-6ba3-4f56-bc18-9d5818ca8af5 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:15.074628502 +0000 UTC m=+50.603476278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wt5zj" (UID: "1b83685a-6ba3-4f56-bc18-9d5818ca8af5") : secret "insights-runtime-extractor-tls" not found Jul 06 20:59:13.331101 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:13.331064 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hwpl" event={"ID":"ecbd164e-7a8c-4bfb-92e0-42b2012f5a5d","Type":"ContainerStarted","Data":"66e5a4229deaeb0c2e95d5d000a6884df33c98874174d2bf5d9426384533bd8a"} Jul 06 20:59:13.355055 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:13.355013 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2hwpl" podStartSLOduration=9.887527545 podStartE2EDuration="48.3549945s" totalImagesPullingTime="38.467466955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:13.35462544 +0000 UTC m=+48.883473238" watchObservedRunningTime="2026-07-06 20:59:13.3549945 +0000 UTC m=+48.883842298" Jul 06 20:59:13.486977 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:13.486944 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:13.588080 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:13.588009 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:13.641470 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:13.641443 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:13.769030 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:13.769008 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-knjjg_a933fdae-34bf-47b1-a811-908317f0df93/node-ca/0.log" Jul 06 20:59:14.374073 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:14.374046 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rqt9r_3af73baf-4a83-4153-9a73-9b9b6674fc09/serve-healthcheck-canary/0.log" Jul 06 20:59:14.501644 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:14.501609 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:14.561934 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:14.561899 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:15.093343 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:15.093313 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:15.093533 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:15.093437 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:15.093533 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:15.093467 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:59:15.093533 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:15.093512 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:59:15.093640 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:15.093550 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-insights-runtime-extractor-tls podName:1b83685a-6ba3-4f56-bc18-9d5818ca8af5 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:19.093534165 +0000 UTC m=+54.622381960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wt5zj" (UID: "1b83685a-6ba3-4f56-bc18-9d5818ca8af5") : secret "insights-runtime-extractor-tls" not found Jul 06 20:59:15.093640 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:15.093565 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-kube-rbac-proxy-cm podName:1b83685a-6ba3-4f56-bc18-9d5818ca8af5 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:19.093559523 +0000 UTC m=+54.622407300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wt5zj" (UID: "1b83685a-6ba3-4f56-bc18-9d5818ca8af5") : configmap "kube-rbac-proxy" not found Jul 06 20:59:15.522216 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:15.522132 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:15.799947 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:15.799915 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-slfss\" (UID: \"f42135c2-6517-4bbf-a412-acb2e43c9b8c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" Jul 06 20:59:15.800129 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:15.799971 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:15.800129 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:15.800002 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-25wgq\" (UID: \"8c7a20d2-0d6c-42df-937a-7933d6a612ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq" Jul 06 20:59:15.800129 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:15.800047 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:15.800129 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:15.800095 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:15.800129 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:15.800095 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 20:59:15.800364 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:15.800166 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:59:15.800364 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:15.800191 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687697f894-mgcsd: secret "image-registry-tls" not found Jul 06 20:59:15.800364 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:15.800189 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 20:59:15.800364 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:15.800241 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls podName:f42135c2-6517-4bbf-a412-acb2e43c9b8c nodeName:}" failed. No retries permitted until 2026-07-06 20:59:31.800220764 +0000 UTC m=+67.329068553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-slfss" (UID: "f42135c2-6517-4bbf-a412-acb2e43c9b8c") : secret "cluster-monitoring-operator-tls" not found Jul 06 20:59:15.800364 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:15.800240 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 20:59:15.800364 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:15.800262 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls podName:8c7a20d2-0d6c-42df-937a-7933d6a612ac nodeName:}" failed. No retries permitted until 2026-07-06 20:59:31.800249355 +0000 UTC m=+67.329097134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-25wgq" (UID: "8c7a20d2-0d6c-42df-937a-7933d6a612ac") : secret "samples-operator-tls" not found Jul 06 20:59:15.800364 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:15.800281 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls podName:819a8df1-a532-4fa1-8adc-5b55e8301925 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:31.800271444 +0000 UTC m=+67.329119224 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls") pod "image-registry-687697f894-mgcsd" (UID: "819a8df1-a532-4fa1-8adc-5b55e8301925") : secret "image-registry-tls" not found Jul 06 20:59:15.800364 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:15.800295 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle podName:a1772b59-30ba-434b-b201-19ab05b7f824 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:31.80028763 +0000 UTC m=+67.329135407 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle") pod "router-default-7df99b5f7c-g9r85" (UID: "a1772b59-30ba-434b-b201-19ab05b7f824") : configmap references non-existent config key: service-ca.crt Jul 06 20:59:15.800364 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:15.800310 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs podName:a1772b59-30ba-434b-b201-19ab05b7f824 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:31.800302706 +0000 UTC m=+67.329150483 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs") pod "router-default-7df99b5f7c-g9r85" (UID: "a1772b59-30ba-434b-b201-19ab05b7f824") : secret "router-metrics-certs-default" not found Jul 06 20:59:15.900693 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:15.900654 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls\") pod \"dns-default-6r4bb\" (UID: \"ba87842f-c445-41bd-9656-bc4a83369b6b\") " pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:15.900854 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:15.900791 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:59:15.900854 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:15.900850 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls podName:ba87842f-c445-41bd-9656-bc4a83369b6b nodeName:}" failed. No retries permitted until 2026-07-06 20:59:31.90083496 +0000 UTC m=+67.429682741 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls") pod "dns-default-6r4bb" (UID: "ba87842f-c445-41bd-9656-bc4a83369b6b") : secret "dns-default-metrics-tls" not found Jul 06 20:59:16.659768 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:16.659738 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:16.760469 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:16.760434 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:16.913336 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:16.913261 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:18.281601 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:18.281575 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:18.823403 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:18.823370 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:18.884647 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:18.884617 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:19.130689 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:19.130593 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:19.130844 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:19.130730 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:19.130844 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:19.130738 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:59:19.130844 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:19.130796 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-insights-runtime-extractor-tls podName:1b83685a-6ba3-4f56-bc18-9d5818ca8af5 nodeName:}" failed. No retries permitted until 2026-07-06 20:59:27.130782875 +0000 UTC m=+62.659630651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wt5zj" (UID: "1b83685a-6ba3-4f56-bc18-9d5818ca8af5") : secret "insights-runtime-extractor-tls" not found Jul 06 20:59:19.131181 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:19.131164 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:20.245829 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:20.245794 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" Jul 06 20:59:20.246202 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:20.245849 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" Jul 06 20:59:20.246202 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:20.246180 2564 scope.go:117] "RemoveContainer" containerID="ac26d92eb10a1d3ff456d506d0a3122e483fd0b3fda7757651d41229de9e46ad" Jul 06 20:59:20.246343 ip-10-0-131-226 kubenswrapper[2564]: E0706 20:59:20.246324 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-z8vzb_openshift-console-operator(a3f837b9-6181-468c-a74e-70d104adfdae)\"" pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" podUID="a3f837b9-6181-468c-a74e-70d104adfdae" Jul 06 20:59:20.490110 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:20.490076 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:20.589905 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:20.589872 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:21.368532 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:21.368482 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:21.546438 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:21.546405 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:21.651866 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:21.651785 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:21.750646 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:21.750612 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:21.855099 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:21.855065 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:21.920113 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:21.920042 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:22.064212 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:22.064184 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:22.877699 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:22.877671 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:23.259868 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:23.259801 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:23.456968 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:23.456941 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:23.648536 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:23.648490 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:24.471657 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:24.471628 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:24.659375 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:24.659345 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:24.851317 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:24.851278 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:25.056623 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:25.056586 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:25.368224 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:25.368193 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:25.468606 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:25.468576 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:26.057742 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:26.057712 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:26.113657 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:26.113627 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:26.474116 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:26.474040 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:26.651733 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:26.651704 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:27.060975 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:27.060941 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:27.165673 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:27.165637 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:27.198938 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:27.198907 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:27.201288 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:27.201271 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b83685a-6ba3-4f56-bc18-9d5818ca8af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wt5zj\" (UID: \"1b83685a-6ba3-4f56-bc18-9d5818ca8af5\") " pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:27.227772 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:27.227749 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mbknp" Jul 06 20:59:27.261771 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:27.261742 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:27.350617 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:27.350549 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-85slc\"" Jul 06 20:59:27.358278 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:27.358260 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wt5zj" Jul 06 20:59:27.489964 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:27.489936 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wt5zj"] Jul 06 20:59:27.492867 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:59:27.492839 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b83685a_6ba3_4f56_bc18_9d5818ca8af5.slice/crio-3f160ec14880fc8c294fca46b2354cde68fbf531811785db56ea2bba3c175dba WatchSource:0}: Error finding container 3f160ec14880fc8c294fca46b2354cde68fbf531811785db56ea2bba3c175dba: Status 404 returned error can't find the container with id 3f160ec14880fc8c294fca46b2354cde68fbf531811785db56ea2bba3c175dba Jul 06 20:59:27.609372 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:27.609291 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:27.703505 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:27.703472 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:28.251024 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:28.250909 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:28.380971 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:28.380927 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wt5zj" event={"ID":"1b83685a-6ba3-4f56-bc18-9d5818ca8af5","Type":"ContainerStarted","Data":"3f160ec14880fc8c294fca46b2354cde68fbf531811785db56ea2bba3c175dba"} Jul 06 20:59:28.456948 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:28.456875 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:28.859829 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:28.859798 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:29.068470 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:29.068431 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:29.457511 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:29.457462 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:30.066822 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:30.066792 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:30.661683 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:30.661638 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:30.733867 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:30.733837 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs\") pod \"network-metrics-daemon-mlbxf\" (UID: \"35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d\") " pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:59:30.734048 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:30.733970 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtjng\" (UniqueName: \"kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng\") pod \"network-check-target-dqlm8\" (UID: \"89ca3d0e-a5af-4f93-af7c-46b8413b9aa7\") " pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:59:30.736703 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:30.736679 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtjng\" (UniqueName: \"kubernetes.io/projected/89ca3d0e-a5af-4f93-af7c-46b8413b9aa7-kube-api-access-jtjng\") pod \"network-check-target-dqlm8\" (UID: \"89ca3d0e-a5af-4f93-af7c-46b8413b9aa7\") " pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:59:30.737218 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:30.737195 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:59:30.747255 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:30.747231 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d-metrics-certs\") pod \"network-metrics-daemon-mlbxf\" (UID: \"35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d\") " pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:59:30.834331 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:30.834291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret\") pod \"global-pull-secret-syncer-f4zwn\" (UID: \"af7599f6-9dd4-4114-9924-17189fb49188\") " pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:59:30.837083 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:30.837057 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:59:30.848043 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:30.848014 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af7599f6-9dd4-4114-9924-17189fb49188-original-pull-secret\") pod \"global-pull-secret-syncer-f4zwn\" (UID: \"af7599f6-9dd4-4114-9924-17189fb49188\") " pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:59:30.855711 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:30.855670 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:30.937596 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:30.937515 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2tvmd\"" Jul 06 20:59:30.944445 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:30.944421 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7wh5f\"" Jul 06 20:59:30.945485 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:30.945454 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:59:30.947464 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:30.947448 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f4zwn" Jul 06 20:59:30.952819 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:30.952800 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mlbxf" Jul 06 20:59:31.150430 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.149668 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dqlm8"] Jul 06 20:59:31.171067 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.171019 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f4zwn"] Jul 06 20:59:31.173997 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:59:31.173971 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf7599f6_9dd4_4114_9924_17189fb49188.slice/crio-bce39c4e84f7d7fa59f4ee838383a28820f7fccc2b8e68f2a0e60ba351b893db WatchSource:0}: Error finding container bce39c4e84f7d7fa59f4ee838383a28820f7fccc2b8e68f2a0e60ba351b893db: Status 404 returned error can't find the container with id bce39c4e84f7d7fa59f4ee838383a28820f7fccc2b8e68f2a0e60ba351b893db Jul 06 20:59:31.188759 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.188690 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mlbxf"] Jul 06 20:59:31.194429 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:59:31.194407 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35e1f9aa_d5ef_4dbb_bd95_a50a02b12a2d.slice/crio-b45298ed350c567064c501e9a3a7f5e253bba5c0a75dab621d2016b76d3aade1 WatchSource:0}: Error finding container b45298ed350c567064c501e9a3a7f5e253bba5c0a75dab621d2016b76d3aade1: Status 404 returned error can't find the container with id b45298ed350c567064c501e9a3a7f5e253bba5c0a75dab621d2016b76d3aade1 Jul 06 20:59:31.258732 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.258698 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:31.392164 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.392130 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wt5zj" event={"ID":"1b83685a-6ba3-4f56-bc18-9d5818ca8af5","Type":"ContainerStarted","Data":"e411fd3be5474a81c9aa66f97e13a861c48116cdad5c2b0df5ef592e9b9c8bda"} Jul 06 20:59:31.393228 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.393201 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mlbxf" event={"ID":"35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d","Type":"ContainerStarted","Data":"b45298ed350c567064c501e9a3a7f5e253bba5c0a75dab621d2016b76d3aade1"} Jul 06 20:59:31.394569 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.394547 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dqlm8" event={"ID":"89ca3d0e-a5af-4f93-af7c-46b8413b9aa7","Type":"ContainerStarted","Data":"23427a8a7fe8cb4ee9ec6e578b396e8acea1592256111c5e047d20e576a5e045"} Jul 06 20:59:31.394674 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.394581 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dqlm8" event={"ID":"89ca3d0e-a5af-4f93-af7c-46b8413b9aa7","Type":"ContainerStarted","Data":"e2be11d03f56e24e5185c582b2bbfb5268abee90bea01f3b495272e62bf853dc"} Jul 06 20:59:31.394674 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.394636 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 20:59:31.395630 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.395613 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f4zwn" event={"ID":"af7599f6-9dd4-4114-9924-17189fb49188","Type":"ContainerStarted","Data":"bce39c4e84f7d7fa59f4ee838383a28820f7fccc2b8e68f2a0e60ba351b893db"} Jul 06 20:59:31.413408 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.413360 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dqlm8" podStartSLOduration=66.413348638 podStartE2EDuration="1m6.413348638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:31.412044758 +0000 UTC m=+66.940892556" watchObservedRunningTime="2026-07-06 20:59:31.413348638 +0000 UTC m=+66.942196433" Jul 06 20:59:31.459088 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.459030 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:31.654704 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.654673 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:31.844424 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.844386 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-slfss\" (UID: \"f42135c2-6517-4bbf-a412-acb2e43c9b8c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" Jul 06 20:59:31.844897 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.844447 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:31.844965 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.844932 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-25wgq\" (UID: \"8c7a20d2-0d6c-42df-937a-7933d6a612ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq" Jul 06 20:59:31.845025 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.845001 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:31.845080 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.845046 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:31.845198 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.845172 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1772b59-30ba-434b-b201-19ab05b7f824-service-ca-bundle\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:31.847762 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.847736 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f42135c2-6517-4bbf-a412-acb2e43c9b8c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-slfss\" (UID: \"f42135c2-6517-4bbf-a412-acb2e43c9b8c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" Jul 06 20:59:31.848360 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.848319 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c7a20d2-0d6c-42df-937a-7933d6a612ac-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-25wgq\" (UID: \"8c7a20d2-0d6c-42df-937a-7933d6a612ac\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq" Jul 06 20:59:31.848908 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.848869 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1772b59-30ba-434b-b201-19ab05b7f824-metrics-certs\") pod \"router-default-7df99b5f7c-g9r85\" (UID: \"a1772b59-30ba-434b-b201-19ab05b7f824\") " pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:31.848993 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.848960 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls\") pod \"image-registry-687697f894-mgcsd\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:31.946154 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.946120 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls\") pod \"dns-default-6r4bb\" (UID: \"ba87842f-c445-41bd-9656-bc4a83369b6b\") " pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:31.949075 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.949047 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba87842f-c445-41bd-9656-bc4a83369b6b-metrics-tls\") pod \"dns-default-6r4bb\" (UID: \"ba87842f-c445-41bd-9656-bc4a83369b6b\") " pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:31.986973 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.986892 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dhdp7\"" Jul 06 20:59:31.995110 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:31.995057 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:32.004808 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.004785 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pqgxr\"" Jul 06 20:59:32.011096 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.011075 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-svlrn\"" Jul 06 20:59:32.012988 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.012966 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:32.018985 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.018956 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" Jul 06 20:59:32.023159 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.023142 2564 scope.go:117] "RemoveContainer" containerID="ac26d92eb10a1d3ff456d506d0a3122e483fd0b3fda7757651d41229de9e46ad" Jul 06 20:59:32.038021 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.038001 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-272kr\"" Jul 06 20:59:32.044127 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.044103 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq" Jul 06 20:59:32.055876 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.055828 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:32.107589 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.107557 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-27mml\"" Jul 06 20:59:32.114534 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.114489 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:32.416742 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.416689 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wt5zj" event={"ID":"1b83685a-6ba3-4f56-bc18-9d5818ca8af5","Type":"ContainerStarted","Data":"462f87add889add3d61d485fb2a57480922a0fb72ae1633f8fcd419093d8a1ea"} Jul 06 20:59:32.422160 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.421756 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 20:59:32.422374 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.422347 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" event={"ID":"a3f837b9-6181-468c-a74e-70d104adfdae","Type":"ContainerStarted","Data":"5cabbe8fb827563355df8c6d83e2a7106a17d8185e0f3eea841fe62d237e0bd6"} Jul 06 20:59:32.425740 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.425401 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" Jul 06 20:59:32.425740 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.425520 2564 patch_prober.go:28] interesting pod/console-operator-68b757fb67-z8vzb container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.10:8443/readyz\": dial tcp 10.132.0.10:8443: connect: connection refused" start-of-body= Jul 06 20:59:32.425740 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.425561 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" podUID="a3f837b9-6181-468c-a74e-70d104adfdae" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.10:8443/readyz\": dial tcp 10.132.0.10:8443: connect: connection refused" Jul 06 20:59:32.428188 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.428017 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss"] Jul 06 20:59:32.434042 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.431766 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq"] Jul 06 20:59:32.466238 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.466145 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" podStartSLOduration=32.975276444 podStartE2EDuration="42.46612319s" totalImagesPullingTime="9.490846746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:32.465900407 +0000 UTC m=+67.994748207" watchObservedRunningTime="2026-07-06 20:59:32.46612319 +0000 UTC m=+67.994970986" Jul 06 20:59:32.488737 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.487004 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-687697f894-mgcsd"] Jul 06 20:59:32.494803 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:59:32.494726 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod819a8df1_a532_4fa1_8adc_5b55e8301925.slice/crio-421969f11c7cbc7059af06200170fa966198ed68a6653b9b5defb88ae328fad0 WatchSource:0}: Error finding container 421969f11c7cbc7059af06200170fa966198ed68a6653b9b5defb88ae328fad0: Status 404 returned error can't find the container with id 421969f11c7cbc7059af06200170fa966198ed68a6653b9b5defb88ae328fad0 Jul 06 20:59:32.511733 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.511619 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6r4bb"] Jul 06 20:59:32.518257 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:59:32.518212 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba87842f_c445_41bd_9656_bc4a83369b6b.slice/crio-28e9107892f43e44a960dd21a89ae656d4e29cdeb8958d88a5b10c7c55f3e84a WatchSource:0}: Error finding container 28e9107892f43e44a960dd21a89ae656d4e29cdeb8958d88a5b10c7c55f3e84a: Status 404 returned error can't find the container with id 28e9107892f43e44a960dd21a89ae656d4e29cdeb8958d88a5b10c7c55f3e84a Jul 06 20:59:32.529635 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:32.529281 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7df99b5f7c-g9r85"] Jul 06 20:59:32.538197 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:59:32.538161 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1772b59_30ba_434b_b201_19ab05b7f824.slice/crio-0b6e676193dd4dea0b83b68fb134534ed5ac87cd590fcaf2ad2b7968dfe03cfb WatchSource:0}: Error finding container 0b6e676193dd4dea0b83b68fb134534ed5ac87cd590fcaf2ad2b7968dfe03cfb: Status 404 returned error can't find the container with id 0b6e676193dd4dea0b83b68fb134534ed5ac87cd590fcaf2ad2b7968dfe03cfb Jul 06 20:59:33.421339 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.421300 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:33.429407 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.429374 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6r4bb" event={"ID":"ba87842f-c445-41bd-9656-bc4a83369b6b","Type":"ContainerStarted","Data":"28e9107892f43e44a960dd21a89ae656d4e29cdeb8958d88a5b10c7c55f3e84a"} Jul 06 20:59:33.433008 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.432977 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mlbxf" event={"ID":"35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d","Type":"ContainerStarted","Data":"088418ce72de6854ec369874e126d44d0eafb04c274bd32323e25f5bc95961c3"} Jul 06 20:59:33.433116 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.433032 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mlbxf" event={"ID":"35e1f9aa-d5ef-4dbb-bd95-a50a02b12a2d","Type":"ContainerStarted","Data":"9562150eea6c8a7769930cde89b5746943389303451ea03f2788e475e676429e"} Jul 06 20:59:33.435464 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.435438 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq" event={"ID":"8c7a20d2-0d6c-42df-937a-7933d6a612ac","Type":"ContainerStarted","Data":"82c27593462369887caa1430ca5a446a2f159819fcb47edc971a6b88a79ad226"} Jul 06 20:59:33.438536 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.438481 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7df99b5f7c-g9r85" event={"ID":"a1772b59-30ba-434b-b201-19ab05b7f824","Type":"ContainerStarted","Data":"08a11b1e3971dae1e995392a2db9df72d9e42fe42a4cc512213464943de49a61"} Jul 06 20:59:33.438627 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.438591 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7df99b5f7c-g9r85" event={"ID":"a1772b59-30ba-434b-b201-19ab05b7f824","Type":"ContainerStarted","Data":"0b6e676193dd4dea0b83b68fb134534ed5ac87cd590fcaf2ad2b7968dfe03cfb"} Jul 06 20:59:33.440787 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.440765 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-687697f894-mgcsd" event={"ID":"819a8df1-a532-4fa1-8adc-5b55e8301925","Type":"ContainerStarted","Data":"8acb0b0eb1cd6575f5d2fe4fc32a73bd2f32e79cb25abec7eab137b82ae42c37"} Jul 06 20:59:33.440881 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.440804 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-687697f894-mgcsd" event={"ID":"819a8df1-a532-4fa1-8adc-5b55e8301925","Type":"ContainerStarted","Data":"421969f11c7cbc7059af06200170fa966198ed68a6653b9b5defb88ae328fad0"} Jul 06 20:59:33.441258 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.441243 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:33.447611 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.447569 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" event={"ID":"f42135c2-6517-4bbf-a412-acb2e43c9b8c","Type":"ContainerStarted","Data":"6ac015541d9b8179fb949b35e807dec1544067f9e85d53d87409af083793f21b"} Jul 06 20:59:33.455273 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.454428 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mlbxf" podStartSLOduration=67.404777575 podStartE2EDuration="1m8.454411959s" totalImagesPullingTime="1.049634384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:33.452713832 +0000 UTC m=+68.981561632" watchObservedRunningTime="2026-07-06 20:59:33.454411959 +0000 UTC m=+68.983259756" Jul 06 20:59:33.455596 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.455580 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-z8vzb" Jul 06 20:59:33.490714 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.490686 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:33.508673 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.508622 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-687697f894-mgcsd" podStartSLOduration=68.508577685 podStartE2EDuration="1m8.508577685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:33.507739779 +0000 UTC m=+69.036587578" watchObservedRunningTime="2026-07-06 20:59:33.508577685 +0000 UTC m=+69.037425484" Jul 06 20:59:33.508858 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.508820 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7df99b5f7c-g9r85" podStartSLOduration=44.508796422 podStartE2EDuration="44.508796422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:33.4861342 +0000 UTC m=+69.014981999" watchObservedRunningTime="2026-07-06 20:59:33.508796422 +0000 UTC m=+69.037644220" Jul 06 20:59:33.550854 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.550813 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:33.737521 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.737287 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:33.887231 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.887195 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:33.948193 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:33.948160 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:34.013337 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:34.013261 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:34.016648 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:34.016623 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:34.082531 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:34.082433 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:34.183597 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:34.183519 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:34.284909 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:34.284868 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:34.341242 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:34.341215 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:34.453425 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:34.453392 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:34.454803 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:34.454782 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7df99b5f7c-g9r85" Jul 06 20:59:35.294057 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:35.294014 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:35.464959 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:35.464924 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:35.527183 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:35.527146 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:35.656344 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:35.656260 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:36.527178 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:36.527139 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:38.814591 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:38.814570 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:38.895463 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:38.895433 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:39.009173 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:39.009141 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:39.125747 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:39.125712 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:39.227697 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:39.227623 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:39.354608 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:39.354570 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:39.476619 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:39.476585 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wt5zj" event={"ID":"1b83685a-6ba3-4f56-bc18-9d5818ca8af5","Type":"ContainerStarted","Data":"abce03f7de472faf7262a2d41360a99993cf628d323095174ff2b6873d8a8427"} Jul 06 20:59:39.478192 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:39.478122 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" event={"ID":"f42135c2-6517-4bbf-a412-acb2e43c9b8c","Type":"ContainerStarted","Data":"9b062d79e4f3f816bf219b773a6c01c25b08ea77e85e76902e7ebcf52535ac4c"} Jul 06 20:59:39.480105 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:39.480078 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6r4bb" event={"ID":"ba87842f-c445-41bd-9656-bc4a83369b6b","Type":"ContainerStarted","Data":"82385599ca8b510c08684ab0ddb67b878c7f098bc5d23fc554824deebfa491b8"} Jul 06 20:59:39.480229 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:39.480130 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6r4bb" event={"ID":"ba87842f-c445-41bd-9656-bc4a83369b6b","Type":"ContainerStarted","Data":"23a97d78478241c1fb3b7b8388120ff35ed2dbed44a13872297c6849af71c7cd"} Jul 06 20:59:39.480229 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:39.480201 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:39.481885 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:39.481858 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq" event={"ID":"8c7a20d2-0d6c-42df-937a-7933d6a612ac","Type":"ContainerStarted","Data":"2782cb6dbebcf9d6eb1968656704d94927fdbcc9e3aa5067843d881856827aec"} Jul 06 20:59:39.481996 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:39.481902 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq" event={"ID":"8c7a20d2-0d6c-42df-937a-7933d6a612ac","Type":"ContainerStarted","Data":"e97636f92ee4dc97c25ce7ff610b4a7d73186627ef1091d2c720edcc0d9dc3ab"} Jul 06 20:59:39.483395 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:39.483370 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f4zwn" event={"ID":"af7599f6-9dd4-4114-9924-17189fb49188","Type":"ContainerStarted","Data":"bcf24d6980221ba1fe5e39cd6ad4b0813dec575bc328ddb5d9b0c401c6769db5"} Jul 06 20:59:39.551332 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:39.551243 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wt5zj" podStartSLOduration=17.494288799 podStartE2EDuration="28.551228021s" totalImagesPullingTime="11.056939222s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:59:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:39.55097256 +0000 UTC m=+75.079820363" watchObservedRunningTime="2026-07-06 20:59:39.551228021 +0000 UTC m=+75.080075817" Jul 06 20:59:39.640596 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:39.640561 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:39.645524 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:39.645467 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-25wgq" podStartSLOduration=43.437504229 podStartE2EDuration="49.645453779s" totalImagesPullingTime="6.20794955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:39.600739143 +0000 UTC m=+75.129586953" watchObservedRunningTime="2026-07-06 20:59:39.645453779 +0000 UTC m=+75.174301555" Jul 06 20:59:39.692418 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:39.692373 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6r4bb" podStartSLOduration=34.496512518 podStartE2EDuration="40.692353143s" totalImagesPullingTime="6.195840625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:39.661934086 +0000 UTC m=+75.190781884" watchObservedRunningTime="2026-07-06 20:59:39.692353143 +0000 UTC m=+75.221200942" Jul 06 20:59:39.693153 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:39.693121 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f4zwn" podStartSLOduration=67.160358802 podStartE2EDuration="1m14.693112037s" totalImagesPullingTime="7.532753235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:39.692620673 +0000 UTC m=+75.221468472" watchObservedRunningTime="2026-07-06 20:59:39.693112037 +0000 UTC m=+75.221959838" Jul 06 20:59:39.767144 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:39.767052 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" podStartSLOduration=44.498392235 podStartE2EDuration="50.767033913s" totalImagesPullingTime="6.268641678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:39.765455704 +0000 UTC m=+75.294303504" watchObservedRunningTime="2026-07-06 20:59:39.767033913 +0000 UTC m=+75.295881710" Jul 06 20:59:40.169848 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:40.169812 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:40.644230 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:40.644196 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:40.710071 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:40.710041 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:42.110919 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:42.110884 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:42.212112 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:42.212080 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:43.664000 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:43.663968 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:43.763875 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:43.763835 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:45.733801 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:45.733772 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:45.804992 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:45.804964 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:46.098542 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:46.098493 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:49.489582 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:49.489553 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6r4bb" Jul 06 20:59:50.329765 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:50.329728 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:50.386274 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:50.386232 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:50.466115 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:50.466080 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:50.569546 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:50.569517 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:51.615413 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:51.615382 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:51.720266 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:51.720231 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:53.368574 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:53.368539 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:53.480882 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:53.480849 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:53.534932 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:53.534906 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:54.543883 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:54.543852 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:54.615235 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:54.614616 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:54.902024 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:54.901989 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:54.995241 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:54.995208 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:55.461893 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:55.461868 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 20:59:55.545103 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:55.545069 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/0.log" Jul 06 20:59:55.545562 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:55.545111 2564 generic.go:356] "Generic (PLEG): container finished" podID="f42135c2-6517-4bbf-a412-acb2e43c9b8c" containerID="9b062d79e4f3f816bf219b773a6c01c25b08ea77e85e76902e7ebcf52535ac4c" exitCode=2 Jul 06 20:59:55.545562 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:55.545177 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" event={"ID":"f42135c2-6517-4bbf-a412-acb2e43c9b8c","Type":"ContainerDied","Data":"9b062d79e4f3f816bf219b773a6c01c25b08ea77e85e76902e7ebcf52535ac4c"} Jul 06 20:59:55.545562 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:55.545489 2564 scope.go:117] "RemoveContainer" containerID="9b062d79e4f3f816bf219b773a6c01c25b08ea77e85e76902e7ebcf52535ac4c" Jul 06 20:59:55.859534 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:55.859489 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:55.923848 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:55.923811 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:56.550769 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:56.550741 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/0.log" Jul 06 20:59:56.551144 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:56.550803 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" event={"ID":"f42135c2-6517-4bbf-a412-acb2e43c9b8c","Type":"ContainerStarted","Data":"a41a166f05b1d6a44c452a573c60f69df4282cca042b3d5188ea39a20ba70867"} Jul 06 20:59:59.387986 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.387951 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:59.459552 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.459513 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vclsq"] Jul 06 20:59:59.461656 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.461635 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.465074 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.465018 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 20:59:59.465074 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.465034 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 20:59:59.465289 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.465038 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tj46g\"" Jul 06 20:59:59.465289 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.465021 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 20:59:59.465289 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.465042 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 20:59:59.479637 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.479617 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:59.547339 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.547308 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:59.550428 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.550410 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-node-exporter-textfile\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.550514 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.550436 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-metrics-client-ca\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.550514 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.550453 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-node-exporter-wtmp\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.550514 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.550474 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.550629 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.550539 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-root\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.550629 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.550575 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-node-exporter-tls\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.550629 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.550619 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-node-exporter-accelerators-collector-config\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.550719 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.550648 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg9h4\" (UniqueName: \"kubernetes.io/projected/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-kube-api-access-zg9h4\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.550719 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.550691 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-sys\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.651836 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.651744 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-sys\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.651836 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.651784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-node-exporter-textfile\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.651836 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.651801 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-metrics-client-ca\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.651836 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.651824 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-node-exporter-wtmp\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.652155 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.651846 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.652155 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.651873 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-root\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.652155 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.651875 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-sys\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.652155 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.651939 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-node-exporter-tls\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.652155 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.651947 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-root\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.652155 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.652011 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-node-exporter-accelerators-collector-config\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.652155 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.652058 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg9h4\" (UniqueName: \"kubernetes.io/projected/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-kube-api-access-zg9h4\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.652494 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.652179 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-node-exporter-textfile\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.652494 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.652225 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-node-exporter-wtmp\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.652669 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.652640 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-node-exporter-accelerators-collector-config\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.652792 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.652690 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-metrics-client-ca\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.654483 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.654460 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-node-exporter-tls\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.654898 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.654875 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.661325 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.661306 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg9h4\" (UniqueName: \"kubernetes.io/projected/d78f8081-8e10-4fbf-ac97-73ab2f9b5666-kube-api-access-zg9h4\") pod \"node-exporter-vclsq\" (UID: \"d78f8081-8e10-4fbf-ac97-73ab2f9b5666\") " pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.673361 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.673305 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:59.770637 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.770599 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vclsq" Jul 06 20:59:59.777223 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.777196 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 20:59:59.782850 ip-10-0-131-226 kubenswrapper[2564]: W0706 20:59:59.782821 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd78f8081_8e10_4fbf_ac97_73ab2f9b5666.slice/crio-bc5f4123c7c2958a269aaebd8d23521e508f9c2684c38833ede0415b5a374db7 WatchSource:0}: Error finding container bc5f4123c7c2958a269aaebd8d23521e508f9c2684c38833ede0415b5a374db7: Status 404 returned error can't find the container with id bc5f4123c7c2958a269aaebd8d23521e508f9c2684c38833ede0415b5a374db7 Jul 06 20:59:59.875213 ip-10-0-131-226 kubenswrapper[2564]: I0706 20:59:59.875176 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:00.447931 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:00.447898 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:00.566606 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:00.566571 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vclsq" event={"ID":"d78f8081-8e10-4fbf-ac97-73ab2f9b5666","Type":"ContainerStarted","Data":"bc5f4123c7c2958a269aaebd8d23521e508f9c2684c38833ede0415b5a374db7"} Jul 06 21:00:00.598938 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:00.598861 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:00.712059 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:00.711969 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:01.487833 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:01.487799 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:01.573943 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:01.573909 2564 generic.go:356] "Generic (PLEG): container finished" podID="d78f8081-8e10-4fbf-ac97-73ab2f9b5666" containerID="b305be579d721910b7836489640fbc94da984a6fda331a521bf6b78b67c30ff9" exitCode=0 Jul 06 21:00:01.574119 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:01.573994 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vclsq" event={"ID":"d78f8081-8e10-4fbf-ac97-73ab2f9b5666","Type":"ContainerDied","Data":"b305be579d721910b7836489640fbc94da984a6fda331a521bf6b78b67c30ff9"} Jul 06 21:00:02.258849 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:02.258810 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-687697f894-mgcsd"] Jul 06 21:00:02.365339 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:02.365303 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:02.425114 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:02.425086 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dqlm8" Jul 06 21:00:02.455786 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:02.455751 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:02.521480 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:02.521396 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:02.584258 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:02.584217 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vclsq" event={"ID":"d78f8081-8e10-4fbf-ac97-73ab2f9b5666","Type":"ContainerStarted","Data":"5ce395d6c14935c712366e34f04953ff8581f2c542210fdaf860b691c537e2db"} Jul 06 21:00:02.584461 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:02.584327 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vclsq" event={"ID":"d78f8081-8e10-4fbf-ac97-73ab2f9b5666","Type":"ContainerStarted","Data":"1c74b8173c76f46833d04ac728ca2d4e110b6e69c284ef47d7bb1f506c099ac1"} Jul 06 21:00:02.607477 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:02.607418 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vclsq" podStartSLOduration=2.48318592 podStartE2EDuration="3.607401315s" totalImagesPullingTime="1.048116903s" totalInitContainerRuntime="76.098492ms" isStatefulPod=true podCreationTimestamp="2026-07-06 20:59:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:00:02.605902611 +0000 UTC m=+98.134750409" watchObservedRunningTime="2026-07-06 21:00:02.607401315 +0000 UTC m=+98.136249115" Jul 06 21:00:02.713021 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:02.712986 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:02.911272 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:02.911238 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:03.015374 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.015340 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:03.174635 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.174539 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:03.529330 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.529294 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:03.793640 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.793555 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7f79777d44-bs4sb"] Jul 06 21:00:03.804035 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.804004 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.810614 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.810586 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7f79777d44-bs4sb"] Jul 06 21:00:03.811453 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.811430 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 21:00:03.811602 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.811452 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8re4p0o12sop4\"" Jul 06 21:00:03.811602 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.811567 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 21:00:03.811709 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.811650 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6zwdr\"" Jul 06 21:00:03.811803 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.811786 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 21:00:03.811862 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.811854 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 21:00:03.884147 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.884111 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-metrics-server-audit-profiles\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.884147 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.884149 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-secret-metrics-server-client-certs\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.884352 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.884168 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-audit-log\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.884352 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.884189 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.884352 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.884309 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-secret-metrics-server-tls\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.884352 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.884338 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-client-ca-bundle\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.884352 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.884353 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz6cs\" (UniqueName: \"kubernetes.io/projected/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-kube-api-access-zz6cs\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.984875 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.984844 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-secret-metrics-server-tls\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.984875 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.984878 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-client-ca-bundle\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.985122 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.984897 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz6cs\" (UniqueName: \"kubernetes.io/projected/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-kube-api-access-zz6cs\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.985122 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.984938 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-metrics-server-audit-profiles\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.985122 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.984964 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-secret-metrics-server-client-certs\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.985122 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.984992 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-audit-log\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.985122 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.985021 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.985524 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.985476 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-audit-log\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.986059 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.986038 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-metrics-server-audit-profiles\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.986137 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.986062 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.987598 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.987558 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-client-ca-bundle\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.987699 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.987666 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-secret-metrics-server-tls\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.987758 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.987707 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-secret-metrics-server-client-certs\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:03.998434 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:03.998408 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz6cs\" (UniqueName: \"kubernetes.io/projected/aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23-kube-api-access-zz6cs\") pod \"metrics-server-7f79777d44-bs4sb\" (UID: \"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23\") " pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:04.114863 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:04.114234 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:04.264090 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:04.264068 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7f79777d44-bs4sb"] Jul 06 21:00:04.266000 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:00:04.265971 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1e3a87_e583_4da5_b5db_f4f6cb0f6b23.slice/crio-33e910b95ba6c80b31c2d654c732812c8f87d577dd91781fc2ca8f1980581ea8 WatchSource:0}: Error finding container 33e910b95ba6c80b31c2d654c732812c8f87d577dd91781fc2ca8f1980581ea8: Status 404 returned error can't find the container with id 33e910b95ba6c80b31c2d654c732812c8f87d577dd91781fc2ca8f1980581ea8 Jul 06 21:00:04.520983 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:04.520896 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:04.593143 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:04.593106 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" event={"ID":"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23","Type":"ContainerStarted","Data":"33e910b95ba6c80b31c2d654c732812c8f87d577dd91781fc2ca8f1980581ea8"} Jul 06 21:00:04.618922 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:04.618882 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:04.989383 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:04.989346 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:05.497265 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:05.497223 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:05.611820 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:05.607866 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:05.892739 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:05.892701 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:06.003966 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:06.003927 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:06.181641 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:06.181563 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:06.601160 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:06.601125 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" event={"ID":"aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23","Type":"ContainerStarted","Data":"e6be116482a8091149c73eef3ad72f9ad4cab3a568fa3e90ef3a44d52eebe282"} Jul 06 21:00:06.625543 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:06.625473 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" podStartSLOduration=2.279640942 podStartE2EDuration="3.62545238s" totalImagesPullingTime="1.345811438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:00:06.623748677 +0000 UTC m=+102.152596475" watchObservedRunningTime="2026-07-06 21:00:06.62545238 +0000 UTC m=+102.154300178" Jul 06 21:00:08.023531 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:08.023486 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:08.126879 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:08.126798 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:09.622489 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:09.622456 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:11.475761 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:11.475728 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:11.588788 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:11.588750 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:12.618930 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:12.618885 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:12.730711 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:12.730674 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:12.828664 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:12.828636 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:16.585185 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:16.585145 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:16.688245 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:16.688212 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:20.472466 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:20.472431 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:20.572279 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:20.572245 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:20.651805 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:20.651773 2564 generic.go:356] "Generic (PLEG): container finished" podID="16ffece4-6447-47d6-a16d-aafe0117f6e9" containerID="eaba70f69c0f94f17aaa08adecb5766a4321c360a3542966df50d696aad0a71d" exitCode=0 Jul 06 21:00:20.651956 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:20.651812 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-592fg" event={"ID":"16ffece4-6447-47d6-a16d-aafe0117f6e9","Type":"ContainerDied","Data":"eaba70f69c0f94f17aaa08adecb5766a4321c360a3542966df50d696aad0a71d"} Jul 06 21:00:20.652154 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:20.652142 2564 scope.go:117] "RemoveContainer" containerID="eaba70f69c0f94f17aaa08adecb5766a4321c360a3542966df50d696aad0a71d" Jul 06 21:00:21.656481 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:21.656442 2564 generic.go:356] "Generic (PLEG): container finished" podID="ebfdc233-cfa7-4ca5-95c2-9a0872c415c9" containerID="bd7151e0de33de5c5e6b90e47182960e3bbd53cd8c5cacd3920cdde719a14b38" exitCode=0 Jul 06 21:00:21.656939 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:21.656525 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc" event={"ID":"ebfdc233-cfa7-4ca5-95c2-9a0872c415c9","Type":"ContainerDied","Data":"bd7151e0de33de5c5e6b90e47182960e3bbd53cd8c5cacd3920cdde719a14b38"} Jul 06 21:00:21.656939 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:21.656871 2564 scope.go:117] "RemoveContainer" containerID="bd7151e0de33de5c5e6b90e47182960e3bbd53cd8c5cacd3920cdde719a14b38" Jul 06 21:00:21.658483 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:21.658466 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-592fg" event={"ID":"16ffece4-6447-47d6-a16d-aafe0117f6e9","Type":"ContainerStarted","Data":"ea89b6cdfc6a9f0fee8a6b42f885a9f34f955f15026921a03c55f791f736f6d3"} Jul 06 21:00:22.663466 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:22.663430 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-n6nxc" event={"ID":"ebfdc233-cfa7-4ca5-95c2-9a0872c415c9","Type":"ContainerStarted","Data":"8e45973ee6fc4d83c2a434b1f4c32dae2a0dde423dc24a917aef6fa33c83bf37"} Jul 06 21:00:24.115151 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:24.115115 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:24.115567 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:24.115175 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:27.280624 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.280580 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-687697f894-mgcsd" podUID="819a8df1-a532-4fa1-8adc-5b55e8301925" containerName="registry" containerID="cri-o://8acb0b0eb1cd6575f5d2fe4fc32a73bd2f32e79cb25abec7eab137b82ae42c37" gracePeriod=30 Jul 06 21:00:27.519966 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.519936 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 21:00:27.581727 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.581647 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-bound-sa-token\") pod \"819a8df1-a532-4fa1-8adc-5b55e8301925\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " Jul 06 21:00:27.581727 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.581692 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/819a8df1-a532-4fa1-8adc-5b55e8301925-installation-pull-secrets\") pod \"819a8df1-a532-4fa1-8adc-5b55e8301925\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " Jul 06 21:00:27.581917 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.581736 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hlbp\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-kube-api-access-6hlbp\") pod \"819a8df1-a532-4fa1-8adc-5b55e8301925\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " Jul 06 21:00:27.581917 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.581772 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/819a8df1-a532-4fa1-8adc-5b55e8301925-image-registry-private-configuration\") pod \"819a8df1-a532-4fa1-8adc-5b55e8301925\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " Jul 06 21:00:27.581917 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.581803 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls\") pod \"819a8df1-a532-4fa1-8adc-5b55e8301925\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " Jul 06 21:00:27.582231 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.582211 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/819a8df1-a532-4fa1-8adc-5b55e8301925-trusted-ca\") pod \"819a8df1-a532-4fa1-8adc-5b55e8301925\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " Jul 06 21:00:27.582291 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.582275 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-certificates\") pod \"819a8df1-a532-4fa1-8adc-5b55e8301925\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " Jul 06 21:00:27.582366 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.582351 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/819a8df1-a532-4fa1-8adc-5b55e8301925-ca-trust-extracted\") pod \"819a8df1-a532-4fa1-8adc-5b55e8301925\" (UID: \"819a8df1-a532-4fa1-8adc-5b55e8301925\") " Jul 06 21:00:27.584614 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.583455 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/819a8df1-a532-4fa1-8adc-5b55e8301925-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "819a8df1-a532-4fa1-8adc-5b55e8301925" (UID: "819a8df1-a532-4fa1-8adc-5b55e8301925"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:00:27.584614 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.583663 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "819a8df1-a532-4fa1-8adc-5b55e8301925" (UID: "819a8df1-a532-4fa1-8adc-5b55e8301925"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:00:27.589344 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.589312 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/819a8df1-a532-4fa1-8adc-5b55e8301925-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "819a8df1-a532-4fa1-8adc-5b55e8301925" (UID: "819a8df1-a532-4fa1-8adc-5b55e8301925"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:00:27.589479 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.589456 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "819a8df1-a532-4fa1-8adc-5b55e8301925" (UID: "819a8df1-a532-4fa1-8adc-5b55e8301925"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:00:27.589564 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.589515 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/819a8df1-a532-4fa1-8adc-5b55e8301925-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "819a8df1-a532-4fa1-8adc-5b55e8301925" (UID: "819a8df1-a532-4fa1-8adc-5b55e8301925"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:00:27.589635 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.589554 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-kube-api-access-6hlbp" (OuterVolumeSpecName: "kube-api-access-6hlbp") pod "819a8df1-a532-4fa1-8adc-5b55e8301925" (UID: "819a8df1-a532-4fa1-8adc-5b55e8301925"). InnerVolumeSpecName "kube-api-access-6hlbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:00:27.589635 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.589620 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "819a8df1-a532-4fa1-8adc-5b55e8301925" (UID: "819a8df1-a532-4fa1-8adc-5b55e8301925"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:00:27.595319 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.595295 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819a8df1-a532-4fa1-8adc-5b55e8301925-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "819a8df1-a532-4fa1-8adc-5b55e8301925" (UID: "819a8df1-a532-4fa1-8adc-5b55e8301925"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:00:27.682412 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.682377 2564 generic.go:356] "Generic (PLEG): container finished" podID="819a8df1-a532-4fa1-8adc-5b55e8301925" containerID="8acb0b0eb1cd6575f5d2fe4fc32a73bd2f32e79cb25abec7eab137b82ae42c37" exitCode=0 Jul 06 21:00:27.682575 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.682444 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-687697f894-mgcsd" Jul 06 21:00:27.682575 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.682464 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-687697f894-mgcsd" event={"ID":"819a8df1-a532-4fa1-8adc-5b55e8301925","Type":"ContainerDied","Data":"8acb0b0eb1cd6575f5d2fe4fc32a73bd2f32e79cb25abec7eab137b82ae42c37"} Jul 06 21:00:27.682575 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.682568 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-687697f894-mgcsd" event={"ID":"819a8df1-a532-4fa1-8adc-5b55e8301925","Type":"ContainerDied","Data":"421969f11c7cbc7059af06200170fa966198ed68a6653b9b5defb88ae328fad0"} Jul 06 21:00:27.682673 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.682589 2564 scope.go:117] "RemoveContainer" containerID="8acb0b0eb1cd6575f5d2fe4fc32a73bd2f32e79cb25abec7eab137b82ae42c37" Jul 06 21:00:27.683039 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.683015 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hlbp\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-kube-api-access-6hlbp\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:00:27.683039 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.683044 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/819a8df1-a532-4fa1-8adc-5b55e8301925-image-registry-private-configuration\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:00:27.683185 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.683085 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-tls\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:00:27.683185 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.683099 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/819a8df1-a532-4fa1-8adc-5b55e8301925-trusted-ca\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:00:27.683185 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.683113 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/819a8df1-a532-4fa1-8adc-5b55e8301925-registry-certificates\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:00:27.683185 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.683124 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/819a8df1-a532-4fa1-8adc-5b55e8301925-ca-trust-extracted\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:00:27.683185 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.683132 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/819a8df1-a532-4fa1-8adc-5b55e8301925-bound-sa-token\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:00:27.683185 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.683140 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/819a8df1-a532-4fa1-8adc-5b55e8301925-installation-pull-secrets\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:00:27.690635 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.690620 2564 scope.go:117] "RemoveContainer" containerID="8acb0b0eb1cd6575f5d2fe4fc32a73bd2f32e79cb25abec7eab137b82ae42c37" Jul 06 21:00:27.690892 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:00:27.690873 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8acb0b0eb1cd6575f5d2fe4fc32a73bd2f32e79cb25abec7eab137b82ae42c37\": container with ID starting with 8acb0b0eb1cd6575f5d2fe4fc32a73bd2f32e79cb25abec7eab137b82ae42c37 not found: ID does not exist" containerID="8acb0b0eb1cd6575f5d2fe4fc32a73bd2f32e79cb25abec7eab137b82ae42c37" Jul 06 21:00:27.690968 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.690902 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8acb0b0eb1cd6575f5d2fe4fc32a73bd2f32e79cb25abec7eab137b82ae42c37"} err="failed to get container status \"8acb0b0eb1cd6575f5d2fe4fc32a73bd2f32e79cb25abec7eab137b82ae42c37\": rpc error: code = NotFound desc = could not find container \"8acb0b0eb1cd6575f5d2fe4fc32a73bd2f32e79cb25abec7eab137b82ae42c37\": container with ID starting with 8acb0b0eb1cd6575f5d2fe4fc32a73bd2f32e79cb25abec7eab137b82ae42c37 not found: ID does not exist" Jul 06 21:00:27.708903 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.708883 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-687697f894-mgcsd"] Jul 06 21:00:27.714056 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:27.714034 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-687697f894-mgcsd"] Jul 06 21:00:29.027762 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:29.027729 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="819a8df1-a532-4fa1-8adc-5b55e8301925" path="/var/lib/kubelet/pods/819a8df1-a532-4fa1-8adc-5b55e8301925/volumes" Jul 06 21:00:31.699663 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:31.699632 2564 generic.go:356] "Generic (PLEG): container finished" podID="79b1e6af-13f8-4946-ae15-78db17d10d04" containerID="92ee143e86f93ae27f384879a05505e43e2cf152f1591cde6bf634124f2ea2a9" exitCode=0 Jul 06 21:00:31.700135 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:31.699666 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl" event={"ID":"79b1e6af-13f8-4946-ae15-78db17d10d04","Type":"ContainerDied","Data":"92ee143e86f93ae27f384879a05505e43e2cf152f1591cde6bf634124f2ea2a9"} Jul 06 21:00:31.700135 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:31.700060 2564 scope.go:117] "RemoveContainer" containerID="92ee143e86f93ae27f384879a05505e43e2cf152f1591cde6bf634124f2ea2a9" Jul 06 21:00:32.706345 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:32.706314 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xvqtl" event={"ID":"79b1e6af-13f8-4946-ae15-78db17d10d04","Type":"ContainerStarted","Data":"d9dba7ef4ca18c28783911137d6d03c063c6d5c6a30af89b9edc448929def544"} Jul 06 21:00:35.465366 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:35.465332 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:35.524579 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:35.524549 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:44.120936 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:44.120905 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:00:44.124736 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:00:44.124715 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7f79777d44-bs4sb" Jul 06 21:01:18.881003 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:18.880972 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:01:19.081670 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:19.081640 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:01:20.882085 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:20.882050 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:01:20.882519 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:20.882488 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/0.log" Jul 06 21:01:20.882570 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:20.882543 2564 generic.go:356] "Generic (PLEG): container finished" podID="f42135c2-6517-4bbf-a412-acb2e43c9b8c" containerID="a41a166f05b1d6a44c452a573c60f69df4282cca042b3d5188ea39a20ba70867" exitCode=2 Jul 06 21:01:20.882605 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:20.882581 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" event={"ID":"f42135c2-6517-4bbf-a412-acb2e43c9b8c","Type":"ContainerDied","Data":"a41a166f05b1d6a44c452a573c60f69df4282cca042b3d5188ea39a20ba70867"} Jul 06 21:01:20.882638 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:20.882625 2564 scope.go:117] "RemoveContainer" containerID="9b062d79e4f3f816bf219b773a6c01c25b08ea77e85e76902e7ebcf52535ac4c" Jul 06 21:01:20.882943 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:20.882918 2564 scope.go:117] "RemoveContainer" containerID="a41a166f05b1d6a44c452a573c60f69df4282cca042b3d5188ea39a20ba70867" Jul 06 21:01:20.883152 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:01:20.883131 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cluster-monitoring-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cluster-monitoring-operator pod=cluster-monitoring-operator-64786d9cbb-slfss_openshift-monitoring(f42135c2-6517-4bbf-a412-acb2e43c9b8c)\"" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" podUID="f42135c2-6517-4bbf-a412-acb2e43c9b8c" Jul 06 21:01:21.800004 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:21.799968 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:01:21.887372 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:21.887345 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:01:36.023285 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:36.023250 2564 scope.go:117] "RemoveContainer" containerID="a41a166f05b1d6a44c452a573c60f69df4282cca042b3d5188ea39a20ba70867" Jul 06 21:01:36.942558 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:36.942529 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:01:36.942725 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:36.942634 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-slfss" event={"ID":"f42135c2-6517-4bbf-a412-acb2e43c9b8c","Type":"ContainerStarted","Data":"922a4c9cba32c16353f89d627b53b152d2d3f230f10af31571e0345f93214059"} Jul 06 21:01:44.643976 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.643940 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-c7ccfd659-9cjpc"] Jul 06 21:01:44.644371 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.644198 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="819a8df1-a532-4fa1-8adc-5b55e8301925" containerName="registry" Jul 06 21:01:44.644371 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.644208 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="819a8df1-a532-4fa1-8adc-5b55e8301925" containerName="registry" Jul 06 21:01:44.644371 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.644257 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="819a8df1-a532-4fa1-8adc-5b55e8301925" containerName="registry" Jul 06 21:01:44.647254 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.647231 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.650669 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.650646 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 21:01:44.650781 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.650651 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 21:01:44.650781 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.650721 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 21:01:44.650895 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.650880 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 21:01:44.651003 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.650986 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 21:01:44.651103 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.651089 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bhvpf\"" Jul 06 21:01:44.656335 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.656316 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 21:01:44.663828 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.663806 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c7ccfd659-9cjpc"] Jul 06 21:01:44.753950 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.753915 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2hvr\" (UniqueName: \"kubernetes.io/projected/fca0c04b-c7ef-4be5-988e-7eea2e83159d-kube-api-access-z2hvr\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.753950 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.753955 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fca0c04b-c7ef-4be5-988e-7eea2e83159d-federate-client-tls\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.754162 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.754034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca0c04b-c7ef-4be5-988e-7eea2e83159d-serving-certs-ca-bundle\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.754162 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.754096 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca0c04b-c7ef-4be5-988e-7eea2e83159d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.754162 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.754126 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fca0c04b-c7ef-4be5-988e-7eea2e83159d-secret-telemeter-client\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.754319 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.754174 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fca0c04b-c7ef-4be5-988e-7eea2e83159d-metrics-client-ca\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.754319 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.754223 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fca0c04b-c7ef-4be5-988e-7eea2e83159d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.754319 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.754252 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fca0c04b-c7ef-4be5-988e-7eea2e83159d-telemeter-client-tls\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.855393 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.855355 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2hvr\" (UniqueName: \"kubernetes.io/projected/fca0c04b-c7ef-4be5-988e-7eea2e83159d-kube-api-access-z2hvr\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.855393 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.855398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fca0c04b-c7ef-4be5-988e-7eea2e83159d-federate-client-tls\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.855681 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.855438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca0c04b-c7ef-4be5-988e-7eea2e83159d-serving-certs-ca-bundle\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.855681 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.855463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca0c04b-c7ef-4be5-988e-7eea2e83159d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.855681 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.855487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fca0c04b-c7ef-4be5-988e-7eea2e83159d-secret-telemeter-client\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.855681 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.855543 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fca0c04b-c7ef-4be5-988e-7eea2e83159d-metrics-client-ca\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.855875 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.855694 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fca0c04b-c7ef-4be5-988e-7eea2e83159d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.855875 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.855747 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fca0c04b-c7ef-4be5-988e-7eea2e83159d-telemeter-client-tls\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.856290 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.856264 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca0c04b-c7ef-4be5-988e-7eea2e83159d-serving-certs-ca-bundle\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.856626 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.856593 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca0c04b-c7ef-4be5-988e-7eea2e83159d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.856626 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.856406 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fca0c04b-c7ef-4be5-988e-7eea2e83159d-metrics-client-ca\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.858280 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.858256 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fca0c04b-c7ef-4be5-988e-7eea2e83159d-telemeter-client-tls\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.858380 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.858304 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fca0c04b-c7ef-4be5-988e-7eea2e83159d-federate-client-tls\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.858692 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.858671 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fca0c04b-c7ef-4be5-988e-7eea2e83159d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.858769 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.858750 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fca0c04b-c7ef-4be5-988e-7eea2e83159d-secret-telemeter-client\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.867326 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.867307 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2hvr\" (UniqueName: \"kubernetes.io/projected/fca0c04b-c7ef-4be5-988e-7eea2e83159d-kube-api-access-z2hvr\") pod \"telemeter-client-c7ccfd659-9cjpc\" (UID: \"fca0c04b-c7ef-4be5-988e-7eea2e83159d\") " pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:44.956459 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:44.956374 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" Jul 06 21:01:45.099249 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:45.099219 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c7ccfd659-9cjpc"] Jul 06 21:01:45.102894 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:01:45.102860 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca0c04b_c7ef_4be5_988e_7eea2e83159d.slice/crio-46fd1f778c98041fde376f4e7d76b2e965548cbf26de1032082d69de17be0212 WatchSource:0}: Error finding container 46fd1f778c98041fde376f4e7d76b2e965548cbf26de1032082d69de17be0212: Status 404 returned error can't find the container with id 46fd1f778c98041fde376f4e7d76b2e965548cbf26de1032082d69de17be0212 Jul 06 21:01:45.974773 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:45.974735 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" event={"ID":"fca0c04b-c7ef-4be5-988e-7eea2e83159d","Type":"ContainerStarted","Data":"46fd1f778c98041fde376f4e7d76b2e965548cbf26de1032082d69de17be0212"} Jul 06 21:01:47.985008 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:47.984970 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" event={"ID":"fca0c04b-c7ef-4be5-988e-7eea2e83159d","Type":"ContainerStarted","Data":"dcc5600561547aba5bcc7d1f133d4a8b1dbd8996c1fe16f64d7bc387d9fe96b0"} Jul 06 21:01:48.990197 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:48.990163 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" event={"ID":"fca0c04b-c7ef-4be5-988e-7eea2e83159d","Type":"ContainerStarted","Data":"b98315e7bb207337f68aba46015011120d482f793f4f7694bc804b4528f4e54f"} Jul 06 21:01:48.990569 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:48.990217 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" event={"ID":"fca0c04b-c7ef-4be5-988e-7eea2e83159d","Type":"ContainerStarted","Data":"79c786a7ca0995e828d4f9e47c6e9107b8b13705f59122b28faed7293d8e6a61"} Jul 06 21:01:49.021149 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:49.021096 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-c7ccfd659-9cjpc" podStartSLOduration=1.833108813 podStartE2EDuration="5.021078851s" totalImagesPullingTime="3.187970038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:01:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:01:49.020536305 +0000 UTC m=+204.549384114" watchObservedRunningTime="2026-07-06 21:01:49.021078851 +0000 UTC m=+204.549926653" Jul 06 21:01:49.911617 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:49.911585 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:01:49.996318 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:49.996288 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:01:51.544069 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:51.544032 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:01:51.617425 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:51.617394 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:01:54.855901 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:54.855867 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:01:54.956821 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:01:54.956794 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:00.985538 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:00.985485 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:01.054043 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:01.054011 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:01.278086 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:01.278059 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:01.379705 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:01.379673 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:01.896067 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:01.896030 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:01.965190 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:01.965162 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:02.689550 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:02.689470 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:02.790363 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:02.790333 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:06.856771 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:06.856738 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:06.960135 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:06.960103 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:11.059350 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:11.059317 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:11.990278 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:11.990243 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:12.101225 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:12.101189 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:12.198198 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:12.198170 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:20.470914 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:20.470877 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:20.569374 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:20.569349 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:20.632493 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:20.632449 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:23.328096 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:23.328052 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:23.422277 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:23.422245 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:59.410883 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:59.410812 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:59.622079 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:02:59.622048 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:04.969917 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:04.969883 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:05.056078 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.056047 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc"] Jul 06 21:03:05.058574 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.058559 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc" Jul 06 21:03:05.067020 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.067000 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 21:03:05.067269 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.067255 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 21:03:05.067885 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.067869 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 06 21:03:05.067964 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.067877 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 21:03:05.079731 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.079708 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc"] Jul 06 21:03:05.082639 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.082610 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:05.174775 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.174746 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:05.181877 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.181857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/23c69767-337d-4270-9b3b-bbc90b94d255-klusterlet-config\") pod \"klusterlet-addon-workmgr-76c7bcd49-qcbcc\" (UID: \"23c69767-337d-4270-9b3b-bbc90b94d255\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc" Jul 06 21:03:05.181948 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.181932 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v897h\" (UniqueName: \"kubernetes.io/projected/23c69767-337d-4270-9b3b-bbc90b94d255-kube-api-access-v897h\") pod \"klusterlet-addon-workmgr-76c7bcd49-qcbcc\" (UID: \"23c69767-337d-4270-9b3b-bbc90b94d255\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc" Jul 06 21:03:05.182050 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.182033 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23c69767-337d-4270-9b3b-bbc90b94d255-tmp\") pod \"klusterlet-addon-workmgr-76c7bcd49-qcbcc\" (UID: \"23c69767-337d-4270-9b3b-bbc90b94d255\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc" Jul 06 21:03:05.282970 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.282944 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23c69767-337d-4270-9b3b-bbc90b94d255-tmp\") pod \"klusterlet-addon-workmgr-76c7bcd49-qcbcc\" (UID: \"23c69767-337d-4270-9b3b-bbc90b94d255\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc" Jul 06 21:03:05.283140 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.282986 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/23c69767-337d-4270-9b3b-bbc90b94d255-klusterlet-config\") pod \"klusterlet-addon-workmgr-76c7bcd49-qcbcc\" (UID: \"23c69767-337d-4270-9b3b-bbc90b94d255\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc" Jul 06 21:03:05.283140 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.283047 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v897h\" (UniqueName: \"kubernetes.io/projected/23c69767-337d-4270-9b3b-bbc90b94d255-kube-api-access-v897h\") pod \"klusterlet-addon-workmgr-76c7bcd49-qcbcc\" (UID: \"23c69767-337d-4270-9b3b-bbc90b94d255\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc" Jul 06 21:03:05.283408 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.283381 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23c69767-337d-4270-9b3b-bbc90b94d255-tmp\") pod \"klusterlet-addon-workmgr-76c7bcd49-qcbcc\" (UID: \"23c69767-337d-4270-9b3b-bbc90b94d255\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc" Jul 06 21:03:05.285788 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.285765 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/23c69767-337d-4270-9b3b-bbc90b94d255-klusterlet-config\") pod \"klusterlet-addon-workmgr-76c7bcd49-qcbcc\" (UID: \"23c69767-337d-4270-9b3b-bbc90b94d255\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc" Jul 06 21:03:05.295098 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.295075 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v897h\" (UniqueName: \"kubernetes.io/projected/23c69767-337d-4270-9b3b-bbc90b94d255-kube-api-access-v897h\") pod \"klusterlet-addon-workmgr-76c7bcd49-qcbcc\" (UID: \"23c69767-337d-4270-9b3b-bbc90b94d255\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc" Jul 06 21:03:05.368117 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.368075 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc" Jul 06 21:03:05.496022 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:05.495990 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc"] Jul 06 21:03:05.499238 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:03:05.499213 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c69767_337d_4270_9b3b_bbc90b94d255.slice/crio-bf48b432f735bb27b0976fc54cd9225a2863f02e610f440de09b6348eb4aa7b9 WatchSource:0}: Error finding container bf48b432f735bb27b0976fc54cd9225a2863f02e610f440de09b6348eb4aa7b9: Status 404 returned error can't find the container with id bf48b432f735bb27b0976fc54cd9225a2863f02e610f440de09b6348eb4aa7b9 Jul 06 21:03:06.266457 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:06.266425 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc" event={"ID":"23c69767-337d-4270-9b3b-bbc90b94d255","Type":"ContainerStarted","Data":"bf48b432f735bb27b0976fc54cd9225a2863f02e610f440de09b6348eb4aa7b9"} Jul 06 21:03:10.285796 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:10.285753 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc" event={"ID":"23c69767-337d-4270-9b3b-bbc90b94d255","Type":"ContainerStarted","Data":"bd426edffe52ccc73de15c03f4943d39010847094ef66240c48d8bfbc9e17061"} Jul 06 21:03:10.286260 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:10.285943 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc" Jul 06 21:03:10.287700 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:10.287679 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc" Jul 06 21:03:10.309738 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:10.309688 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7bcd49-qcbcc" podStartSLOduration=1.5744422660000001 podStartE2EDuration="5.30967089s" totalImagesPullingTime="3.735228624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:03:10.307530873 +0000 UTC m=+285.836378669" watchObservedRunningTime="2026-07-06 21:03:10.30967089 +0000 UTC m=+285.838518690" Jul 06 21:03:24.959578 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:24.959551 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:03:24.960112 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:24.960096 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:03:24.963200 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:24.963176 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 21:03:24.963753 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:24.963730 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 21:03:24.971581 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:24.971562 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 21:03:24.971888 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:24.971872 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 21:03:24.975582 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:24.975563 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 21:03:26.189782 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:26.189732 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:27.308743 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:27.308699 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:28.170625 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:28.170595 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjq9v"] Jul 06 21:03:28.173506 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:28.173479 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjq9v" Jul 06 21:03:28.176047 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:28.176028 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fs9z2\"" Jul 06 21:03:28.176378 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:28.176364 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 21:03:28.176707 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:28.176694 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 21:03:28.190730 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:28.190704 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjq9v"] Jul 06 21:03:28.370464 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:28.370430 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e143827-a22b-44e0-beed-89f2bf1aac9f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fjq9v\" (UID: \"5e143827-a22b-44e0-beed-89f2bf1aac9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjq9v" Jul 06 21:03:28.370464 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:28.370468 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc29w\" (UniqueName: \"kubernetes.io/projected/5e143827-a22b-44e0-beed-89f2bf1aac9f-kube-api-access-dc29w\") pod \"cert-manager-operator-controller-manager-55c444bf86-fjq9v\" (UID: \"5e143827-a22b-44e0-beed-89f2bf1aac9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjq9v" Jul 06 21:03:28.471657 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:28.471564 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e143827-a22b-44e0-beed-89f2bf1aac9f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fjq9v\" (UID: \"5e143827-a22b-44e0-beed-89f2bf1aac9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjq9v" Jul 06 21:03:28.471657 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:28.471624 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc29w\" (UniqueName: \"kubernetes.io/projected/5e143827-a22b-44e0-beed-89f2bf1aac9f-kube-api-access-dc29w\") pod \"cert-manager-operator-controller-manager-55c444bf86-fjq9v\" (UID: \"5e143827-a22b-44e0-beed-89f2bf1aac9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjq9v" Jul 06 21:03:28.471978 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:28.471948 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e143827-a22b-44e0-beed-89f2bf1aac9f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fjq9v\" (UID: \"5e143827-a22b-44e0-beed-89f2bf1aac9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjq9v" Jul 06 21:03:28.487012 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:28.486984 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc29w\" (UniqueName: \"kubernetes.io/projected/5e143827-a22b-44e0-beed-89f2bf1aac9f-kube-api-access-dc29w\") pod \"cert-manager-operator-controller-manager-55c444bf86-fjq9v\" (UID: \"5e143827-a22b-44e0-beed-89f2bf1aac9f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjq9v" Jul 06 21:03:28.782248 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:28.782214 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjq9v" Jul 06 21:03:28.921540 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:28.921493 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjq9v"] Jul 06 21:03:28.924276 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:03:28.924246 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e143827_a22b_44e0_beed_89f2bf1aac9f.slice/crio-10115ae54fd44401931d67a9c9b949fb16475c4917b016d14da884f5e54125b5 WatchSource:0}: Error finding container 10115ae54fd44401931d67a9c9b949fb16475c4917b016d14da884f5e54125b5: Status 404 returned error can't find the container with id 10115ae54fd44401931d67a9c9b949fb16475c4917b016d14da884f5e54125b5 Jul 06 21:03:28.927154 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:28.927136 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 21:03:29.354695 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:29.354662 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjq9v" event={"ID":"5e143827-a22b-44e0-beed-89f2bf1aac9f","Type":"ContainerStarted","Data":"10115ae54fd44401931d67a9c9b949fb16475c4917b016d14da884f5e54125b5"} Jul 06 21:03:29.815043 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:29.815014 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:29.916266 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:29.916235 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:32.369378 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:32.369346 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjq9v" event={"ID":"5e143827-a22b-44e0-beed-89f2bf1aac9f","Type":"ContainerStarted","Data":"b30b5af877c2a98937288bd3830f8c189345bc73d35deedec2a2756917dbb7b9"} Jul 06 21:03:32.394370 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:32.394319 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjq9v" podStartSLOduration=1.729810583 podStartE2EDuration="4.394301607s" totalImagesPullingTime="2.664491024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:03:32.391735331 +0000 UTC m=+307.920583132" watchObservedRunningTime="2026-07-06 21:03:32.394301607 +0000 UTC m=+307.923149406" Jul 06 21:03:32.617263 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:32.617235 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:32.714364 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:32.714274 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:32.828435 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:32.828388 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:32.922266 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:32.922240 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:33.034611 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:33.034583 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xhwmh"] Jul 06 21:03:33.036760 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:33.036743 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xhwmh" Jul 06 21:03:33.047120 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:33.047100 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 21:03:33.047261 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:33.047130 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 21:03:33.047261 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:33.047100 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gmljn\"" Jul 06 21:03:33.055979 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:33.055958 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xhwmh"] Jul 06 21:03:33.104562 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:33.104537 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c39999a-9a0f-4043-a89b-45b0f1b1b1a9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xhwmh\" (UID: \"3c39999a-9a0f-4043-a89b-45b0f1b1b1a9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xhwmh" Jul 06 21:03:33.104702 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:33.104593 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5lnk\" (UniqueName: \"kubernetes.io/projected/3c39999a-9a0f-4043-a89b-45b0f1b1b1a9-kube-api-access-b5lnk\") pod \"cert-manager-webhook-6486ffd997-xhwmh\" (UID: \"3c39999a-9a0f-4043-a89b-45b0f1b1b1a9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xhwmh" Jul 06 21:03:33.205628 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:33.205592 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c39999a-9a0f-4043-a89b-45b0f1b1b1a9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xhwmh\" (UID: \"3c39999a-9a0f-4043-a89b-45b0f1b1b1a9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xhwmh" Jul 06 21:03:33.205784 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:33.205656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5lnk\" (UniqueName: \"kubernetes.io/projected/3c39999a-9a0f-4043-a89b-45b0f1b1b1a9-kube-api-access-b5lnk\") pod \"cert-manager-webhook-6486ffd997-xhwmh\" (UID: \"3c39999a-9a0f-4043-a89b-45b0f1b1b1a9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xhwmh" Jul 06 21:03:33.221799 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:33.221762 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c39999a-9a0f-4043-a89b-45b0f1b1b1a9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xhwmh\" (UID: \"3c39999a-9a0f-4043-a89b-45b0f1b1b1a9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xhwmh" Jul 06 21:03:33.221919 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:33.221806 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5lnk\" (UniqueName: \"kubernetes.io/projected/3c39999a-9a0f-4043-a89b-45b0f1b1b1a9-kube-api-access-b5lnk\") pod \"cert-manager-webhook-6486ffd997-xhwmh\" (UID: \"3c39999a-9a0f-4043-a89b-45b0f1b1b1a9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xhwmh" Jul 06 21:03:33.358746 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:33.358651 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xhwmh" Jul 06 21:03:33.492826 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:33.492794 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xhwmh"] Jul 06 21:03:33.495599 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:03:33.495556 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c39999a_9a0f_4043_a89b_45b0f1b1b1a9.slice/crio-1b9f6cd02d8ff8f5fd676e782baf948f6d51efaad2518b40452a59301d8914f0 WatchSource:0}: Error finding container 1b9f6cd02d8ff8f5fd676e782baf948f6d51efaad2518b40452a59301d8914f0: Status 404 returned error can't find the container with id 1b9f6cd02d8ff8f5fd676e782baf948f6d51efaad2518b40452a59301d8914f0 Jul 06 21:03:34.380687 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:34.380646 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xhwmh" event={"ID":"3c39999a-9a0f-4043-a89b-45b0f1b1b1a9","Type":"ContainerStarted","Data":"1b9f6cd02d8ff8f5fd676e782baf948f6d51efaad2518b40452a59301d8914f0"} Jul 06 21:03:35.020612 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:35.020570 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:35.223672 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:35.223566 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:36.390066 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:36.389974 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xhwmh" event={"ID":"3c39999a-9a0f-4043-a89b-45b0f1b1b1a9","Type":"ContainerStarted","Data":"3bd01d00ec3a2c955b1b247dde891dd80a517a6a596b9b572905400dc9a359c7"} Jul 06 21:03:36.390066 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:36.390036 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xhwmh" Jul 06 21:03:36.411632 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:36.411582 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xhwmh" podStartSLOduration=0.819135675 podStartE2EDuration="3.411567528s" totalImagesPullingTime="2.592431853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:03:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:03:36.410136921 +0000 UTC m=+311.938984739" watchObservedRunningTime="2026-07-06 21:03:36.411567528 +0000 UTC m=+311.940415327" Jul 06 21:03:36.611695 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:36.611665 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:36.705803 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:36.705715 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:42.237947 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:42.237914 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:42.396251 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:42.396221 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xhwmh" Jul 06 21:03:44.845744 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:44.845709 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:44.963352 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:44.963318 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:48.757493 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:48.757462 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:51.415399 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:51.415364 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:51.516698 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:51.516665 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:53.206032 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:03:53.206000 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:04.708970 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:04.708931 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:04.795214 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:04.795165 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:05.815279 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:05.815244 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:05.909251 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:05.909220 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:06.437700 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:06.437665 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:06.850878 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:06.850842 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:06.945222 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:06.945189 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:07.015487 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.015450 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4"] Jul 06 21:04:07.020888 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.020873 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:07.024951 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.024925 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 21:04:07.025101 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.025078 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 21:04:07.028008 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.027992 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 21:04:07.028095 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.028005 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2tlc7\"" Jul 06 21:04:07.028221 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.028209 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 21:04:07.040005 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.039982 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4"] Jul 06 21:04:07.084607 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.084572 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/64383df9-e442-470c-b813-92a765e3d99a-manifests\") pod \"opendatahub-operator-controller-manager-5bd9f97986-gc8w4\" (UID: \"64383df9-e442-470c-b813-92a765e3d99a\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:07.084769 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.084617 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cq6s\" (UniqueName: \"kubernetes.io/projected/64383df9-e442-470c-b813-92a765e3d99a-kube-api-access-7cq6s\") pod \"opendatahub-operator-controller-manager-5bd9f97986-gc8w4\" (UID: \"64383df9-e442-470c-b813-92a765e3d99a\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:07.084769 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.084664 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/64383df9-e442-470c-b813-92a765e3d99a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bd9f97986-gc8w4\" (UID: \"64383df9-e442-470c-b813-92a765e3d99a\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:07.084769 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.084689 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64383df9-e442-470c-b813-92a765e3d99a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bd9f97986-gc8w4\" (UID: \"64383df9-e442-470c-b813-92a765e3d99a\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:07.084769 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.084724 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64383df9-e442-470c-b813-92a765e3d99a-tmp\") pod \"opendatahub-operator-controller-manager-5bd9f97986-gc8w4\" (UID: \"64383df9-e442-470c-b813-92a765e3d99a\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:07.168565 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.168459 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:07.186048 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.186003 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/64383df9-e442-470c-b813-92a765e3d99a-manifests\") pod \"opendatahub-operator-controller-manager-5bd9f97986-gc8w4\" (UID: \"64383df9-e442-470c-b813-92a765e3d99a\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:07.186192 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.186065 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cq6s\" (UniqueName: \"kubernetes.io/projected/64383df9-e442-470c-b813-92a765e3d99a-kube-api-access-7cq6s\") pod \"opendatahub-operator-controller-manager-5bd9f97986-gc8w4\" (UID: \"64383df9-e442-470c-b813-92a765e3d99a\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:07.186192 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.186132 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/64383df9-e442-470c-b813-92a765e3d99a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bd9f97986-gc8w4\" (UID: \"64383df9-e442-470c-b813-92a765e3d99a\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:07.186192 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.186155 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64383df9-e442-470c-b813-92a765e3d99a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bd9f97986-gc8w4\" (UID: \"64383df9-e442-470c-b813-92a765e3d99a\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:07.186416 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.186194 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64383df9-e442-470c-b813-92a765e3d99a-tmp\") pod \"opendatahub-operator-controller-manager-5bd9f97986-gc8w4\" (UID: \"64383df9-e442-470c-b813-92a765e3d99a\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:07.186416 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.186405 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/64383df9-e442-470c-b813-92a765e3d99a-manifests\") pod \"opendatahub-operator-controller-manager-5bd9f97986-gc8w4\" (UID: \"64383df9-e442-470c-b813-92a765e3d99a\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:07.188596 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.188568 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64383df9-e442-470c-b813-92a765e3d99a-tmp\") pod \"opendatahub-operator-controller-manager-5bd9f97986-gc8w4\" (UID: \"64383df9-e442-470c-b813-92a765e3d99a\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:07.188707 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.188675 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64383df9-e442-470c-b813-92a765e3d99a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bd9f97986-gc8w4\" (UID: \"64383df9-e442-470c-b813-92a765e3d99a\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:07.188823 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.188806 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/64383df9-e442-470c-b813-92a765e3d99a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bd9f97986-gc8w4\" (UID: \"64383df9-e442-470c-b813-92a765e3d99a\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:07.202327 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.202294 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cq6s\" (UniqueName: \"kubernetes.io/projected/64383df9-e442-470c-b813-92a765e3d99a-kube-api-access-7cq6s\") pod \"opendatahub-operator-controller-manager-5bd9f97986-gc8w4\" (UID: \"64383df9-e442-470c-b813-92a765e3d99a\") " pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:07.259807 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.259771 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:07.330748 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.330718 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:07.377708 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.377678 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:07.478837 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.478766 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:07.491708 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.491682 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4"] Jul 06 21:04:07.494684 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:04:07.494659 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64383df9_e442_470c_b813_92a765e3d99a.slice/crio-69b4f61290b2b4f73af2979c7fff49cfe415103cd64f281b96f0d009925ce6e5 WatchSource:0}: Error finding container 69b4f61290b2b4f73af2979c7fff49cfe415103cd64f281b96f0d009925ce6e5: Status 404 returned error can't find the container with id 69b4f61290b2b4f73af2979c7fff49cfe415103cd64f281b96f0d009925ce6e5 Jul 06 21:04:07.514269 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.514245 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" event={"ID":"64383df9-e442-470c-b813-92a765e3d99a","Type":"ContainerStarted","Data":"69b4f61290b2b4f73af2979c7fff49cfe415103cd64f281b96f0d009925ce6e5"} Jul 06 21:04:07.584303 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.584268 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:07.679417 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.679390 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:07.781409 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:07.781359 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:09.593113 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:09.593076 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:09.716100 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:09.716062 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:11.537668 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:11.537623 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" event={"ID":"64383df9-e442-470c-b813-92a765e3d99a","Type":"ContainerStarted","Data":"7708130c23a72e15666b821564f60a42542d802a65a265770a1527014d816a63"} Jul 06 21:04:12.543122 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:12.543083 2564 generic.go:356] "Generic (PLEG): container finished" podID="64383df9-e442-470c-b813-92a765e3d99a" containerID="7708130c23a72e15666b821564f60a42542d802a65a265770a1527014d816a63" exitCode=0 Jul 06 21:04:12.543484 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:12.543126 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" event={"ID":"64383df9-e442-470c-b813-92a765e3d99a","Type":"ContainerDied","Data":"7708130c23a72e15666b821564f60a42542d802a65a265770a1527014d816a63"} Jul 06 21:04:13.549238 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:13.549202 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" event={"ID":"64383df9-e442-470c-b813-92a765e3d99a","Type":"ContainerStarted","Data":"55c23240a653c110737299d337e51d18a2eaf417ecab0088be784982a2b6d774"} Jul 06 21:04:13.549725 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:13.549329 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:24.555643 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:24.555611 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" Jul 06 21:04:24.585595 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:24.585536 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bd9f97986-gc8w4" podStartSLOduration=13.99880453 podStartE2EDuration="18.585486613s" totalImagesPullingTime="3.490167251s" totalInitContainerRuntime="1.096514832s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:04:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:13.579877872 +0000 UTC m=+349.108725671" watchObservedRunningTime="2026-07-06 21:04:24.585486613 +0000 UTC m=+360.114334412" Jul 06 21:04:26.200874 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.200837 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2"] Jul 06 21:04:26.204364 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.204344 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" Jul 06 21:04:26.214440 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.214421 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 21:04:26.215459 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.215437 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vln87\"" Jul 06 21:04:26.215647 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.215536 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 21:04:26.215647 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.215562 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 21:04:26.215647 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.215605 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 21:04:26.215815 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.215801 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 21:04:26.218084 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.218063 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2"] Jul 06 21:04:26.302252 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.302216 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:26.348129 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.348095 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6-cert\") pod \"lws-controller-manager-6cfbcfb449-jhnm2\" (UID: \"466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6\") " pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" Jul 06 21:04:26.348320 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.348179 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lpql\" (UniqueName: \"kubernetes.io/projected/466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6-kube-api-access-8lpql\") pod \"lws-controller-manager-6cfbcfb449-jhnm2\" (UID: \"466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6\") " pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" Jul 06 21:04:26.348320 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.348222 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6-manager-config\") pod \"lws-controller-manager-6cfbcfb449-jhnm2\" (UID: \"466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6\") " pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" Jul 06 21:04:26.348320 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.348284 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6-metrics-cert\") pod \"lws-controller-manager-6cfbcfb449-jhnm2\" (UID: \"466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6\") " pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" Jul 06 21:04:26.449730 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.449699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6-metrics-cert\") pod \"lws-controller-manager-6cfbcfb449-jhnm2\" (UID: \"466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6\") " pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" Jul 06 21:04:26.449921 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.449737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6-cert\") pod \"lws-controller-manager-6cfbcfb449-jhnm2\" (UID: \"466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6\") " pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" Jul 06 21:04:26.449921 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.449784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lpql\" (UniqueName: \"kubernetes.io/projected/466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6-kube-api-access-8lpql\") pod \"lws-controller-manager-6cfbcfb449-jhnm2\" (UID: \"466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6\") " pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" Jul 06 21:04:26.449921 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.449809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6-manager-config\") pod \"lws-controller-manager-6cfbcfb449-jhnm2\" (UID: \"466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6\") " pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" Jul 06 21:04:26.450394 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.450373 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6-manager-config\") pod \"lws-controller-manager-6cfbcfb449-jhnm2\" (UID: \"466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6\") " pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" Jul 06 21:04:26.452492 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.452432 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6-cert\") pod \"lws-controller-manager-6cfbcfb449-jhnm2\" (UID: \"466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6\") " pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" Jul 06 21:04:26.452592 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.452553 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6-metrics-cert\") pod \"lws-controller-manager-6cfbcfb449-jhnm2\" (UID: \"466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6\") " pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" Jul 06 21:04:26.476938 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.476918 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lpql\" (UniqueName: \"kubernetes.io/projected/466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6-kube-api-access-8lpql\") pod \"lws-controller-manager-6cfbcfb449-jhnm2\" (UID: \"466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6\") " pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" Jul 06 21:04:26.513485 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.513460 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" Jul 06 21:04:26.520768 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.520749 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:26.667218 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:26.667186 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2"] Jul 06 21:04:26.670157 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:04:26.670129 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod466ad7c2_fbbe_44bc_853f_ea2a8da9a7a6.slice/crio-37baa204059e9b9efd9ddab2f156ca2e81a7eacc283ee969f58ac8cee394dd44 WatchSource:0}: Error finding container 37baa204059e9b9efd9ddab2f156ca2e81a7eacc283ee969f58ac8cee394dd44: Status 404 returned error can't find the container with id 37baa204059e9b9efd9ddab2f156ca2e81a7eacc283ee969f58ac8cee394dd44 Jul 06 21:04:27.465121 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:27.465043 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:27.567659 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:27.567577 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:27.611026 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:27.610963 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" event={"ID":"466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6","Type":"ContainerStarted","Data":"37baa204059e9b9efd9ddab2f156ca2e81a7eacc283ee969f58ac8cee394dd44"} Jul 06 21:04:27.673588 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:27.673526 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:27.968460 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:27.968418 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:28.087129 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:28.087021 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:28.570256 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:28.570213 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:29.621172 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:29.621139 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" event={"ID":"466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6","Type":"ContainerStarted","Data":"2308fe0becd416b7a9cc9e1f84bc5882d4980d0f1cb20d64d9031f4d3192eba9"} Jul 06 21:04:29.621568 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:29.621265 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" Jul 06 21:04:29.647514 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:29.647452 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" podStartSLOduration=1.266593432 podStartE2EDuration="3.647438891s" totalImagesPullingTime="2.380845459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:29.646804744 +0000 UTC m=+365.175652543" watchObservedRunningTime="2026-07-06 21:04:29.647438891 +0000 UTC m=+365.176286689" Jul 06 21:04:37.725804 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:37.725763 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:37.892772 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:37.892742 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-686455847d-lm59s"] Jul 06 21:04:37.895020 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:37.895005 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-686455847d-lm59s" Jul 06 21:04:37.908837 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:37.908814 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zx4hf\"" Jul 06 21:04:37.908980 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:37.908963 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 21:04:37.909057 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:37.908969 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 21:04:37.913141 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:37.913122 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-686455847d-lm59s"] Jul 06 21:04:37.941749 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:37.941724 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ndts\" (UniqueName: \"kubernetes.io/projected/5881c4aa-faa0-4d05-b904-bbdf564bd48c-kube-api-access-8ndts\") pod \"kube-auth-proxy-686455847d-lm59s\" (UID: \"5881c4aa-faa0-4d05-b904-bbdf564bd48c\") " pod="openshift-ingress/kube-auth-proxy-686455847d-lm59s" Jul 06 21:04:37.941876 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:37.941783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5881c4aa-faa0-4d05-b904-bbdf564bd48c-tmp\") pod \"kube-auth-proxy-686455847d-lm59s\" (UID: \"5881c4aa-faa0-4d05-b904-bbdf564bd48c\") " pod="openshift-ingress/kube-auth-proxy-686455847d-lm59s" Jul 06 21:04:37.941876 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:37.941863 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5881c4aa-faa0-4d05-b904-bbdf564bd48c-tls-certs\") pod \"kube-auth-proxy-686455847d-lm59s\" (UID: \"5881c4aa-faa0-4d05-b904-bbdf564bd48c\") " pod="openshift-ingress/kube-auth-proxy-686455847d-lm59s" Jul 06 21:04:38.042873 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:38.042840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5881c4aa-faa0-4d05-b904-bbdf564bd48c-tmp\") pod \"kube-auth-proxy-686455847d-lm59s\" (UID: \"5881c4aa-faa0-4d05-b904-bbdf564bd48c\") " pod="openshift-ingress/kube-auth-proxy-686455847d-lm59s" Jul 06 21:04:38.043059 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:38.042885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5881c4aa-faa0-4d05-b904-bbdf564bd48c-tls-certs\") pod \"kube-auth-proxy-686455847d-lm59s\" (UID: \"5881c4aa-faa0-4d05-b904-bbdf564bd48c\") " pod="openshift-ingress/kube-auth-proxy-686455847d-lm59s" Jul 06 21:04:38.043059 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:38.042943 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ndts\" (UniqueName: \"kubernetes.io/projected/5881c4aa-faa0-4d05-b904-bbdf564bd48c-kube-api-access-8ndts\") pod \"kube-auth-proxy-686455847d-lm59s\" (UID: \"5881c4aa-faa0-4d05-b904-bbdf564bd48c\") " pod="openshift-ingress/kube-auth-proxy-686455847d-lm59s" Jul 06 21:04:38.043172 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:04:38.043078 2564 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 06 21:04:38.043172 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:04:38.043164 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5881c4aa-faa0-4d05-b904-bbdf564bd48c-tls-certs podName:5881c4aa-faa0-4d05-b904-bbdf564bd48c nodeName:}" failed. No retries permitted until 2026-07-06 21:04:38.543141891 +0000 UTC m=+374.071989683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5881c4aa-faa0-4d05-b904-bbdf564bd48c-tls-certs") pod "kube-auth-proxy-686455847d-lm59s" (UID: "5881c4aa-faa0-4d05-b904-bbdf564bd48c") : secret "kube-auth-proxy-tls" not found Jul 06 21:04:38.045292 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:38.045269 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5881c4aa-faa0-4d05-b904-bbdf564bd48c-tmp\") pod \"kube-auth-proxy-686455847d-lm59s\" (UID: \"5881c4aa-faa0-4d05-b904-bbdf564bd48c\") " pod="openshift-ingress/kube-auth-proxy-686455847d-lm59s" Jul 06 21:04:38.053926 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:38.053907 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ndts\" (UniqueName: \"kubernetes.io/projected/5881c4aa-faa0-4d05-b904-bbdf564bd48c-kube-api-access-8ndts\") pod \"kube-auth-proxy-686455847d-lm59s\" (UID: \"5881c4aa-faa0-4d05-b904-bbdf564bd48c\") " pod="openshift-ingress/kube-auth-proxy-686455847d-lm59s" Jul 06 21:04:38.213849 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:38.213818 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:38.547610 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:38.547578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5881c4aa-faa0-4d05-b904-bbdf564bd48c-tls-certs\") pod \"kube-auth-proxy-686455847d-lm59s\" (UID: \"5881c4aa-faa0-4d05-b904-bbdf564bd48c\") " pod="openshift-ingress/kube-auth-proxy-686455847d-lm59s" Jul 06 21:04:38.550073 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:38.550046 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5881c4aa-faa0-4d05-b904-bbdf564bd48c-tls-certs\") pod \"kube-auth-proxy-686455847d-lm59s\" (UID: \"5881c4aa-faa0-4d05-b904-bbdf564bd48c\") " pod="openshift-ingress/kube-auth-proxy-686455847d-lm59s" Jul 06 21:04:38.804086 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:38.804006 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-686455847d-lm59s" Jul 06 21:04:38.976149 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:38.976117 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-686455847d-lm59s"] Jul 06 21:04:38.980746 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:04:38.980712 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5881c4aa_faa0_4d05_b904_bbdf564bd48c.slice/crio-31687995b112cf26858eaddfd85b0824deb348b5c32ffcefbbe6f2bd878770fc WatchSource:0}: Error finding container 31687995b112cf26858eaddfd85b0824deb348b5c32ffcefbbe6f2bd878770fc: Status 404 returned error can't find the container with id 31687995b112cf26858eaddfd85b0824deb348b5c32ffcefbbe6f2bd878770fc Jul 06 21:04:39.175692 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:39.175607 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:39.279708 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:39.279673 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:39.366909 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:39.366878 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:39.448939 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:39.448861 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:39.666263 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:39.666231 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-686455847d-lm59s" event={"ID":"5881c4aa-faa0-4d05-b904-bbdf564bd48c","Type":"ContainerStarted","Data":"31687995b112cf26858eaddfd85b0824deb348b5c32ffcefbbe6f2bd878770fc"} Jul 06 21:04:40.261850 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:40.261817 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:40.365716 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:40.365684 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:40.628873 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:40.628838 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6cfbcfb449-jhnm2" Jul 06 21:04:40.643755 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:40.643721 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:40.743813 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:40.743779 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:40.810976 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:40.810942 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:42.130610 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:42.130568 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:43.685881 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:43.685846 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-686455847d-lm59s" event={"ID":"5881c4aa-faa0-4d05-b904-bbdf564bd48c","Type":"ContainerStarted","Data":"68bd568fa0c61d5dea52c14cb7a72d1bebae2041259c6863f072138987776199"} Jul 06 21:04:43.720320 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:43.720239 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-686455847d-lm59s" podStartSLOduration=3.095994644 podStartE2EDuration="6.720223424s" totalImagesPullingTime="3.62422878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:04:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:43.717089348 +0000 UTC m=+379.245937147" watchObservedRunningTime="2026-07-06 21:04:43.720223424 +0000 UTC m=+379.249071223" Jul 06 21:04:45.411525 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:45.411471 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:45.502068 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:45.502036 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:45.888061 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:45.888031 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:46.074821 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:46.074791 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:04:46.175688 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:04:46.175608 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:05:18.099680 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:05:18.099637 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:05:27.879153 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:05:27.879112 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:05:27.989618 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:05:27.989588 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:05:28.122857 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:05:28.122816 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:05:28.840806 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:05:28.840770 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:05:29.036767 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:05:29.036733 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:05:54.989312 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:05:54.989219 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:05:55.781217 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:05:55.781180 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:00.397919 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:00.397882 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:02.604320 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:02.604282 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:02.709729 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:02.709688 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:03.408843 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:03.408803 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:04.053003 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:04.052980 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:05.458102 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:05.458073 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:07.830036 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:07.829998 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:09.225193 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:09.225159 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:10.830832 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:10.830801 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:10.936390 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:10.936357 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:11.247868 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:11.247791 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:11.364034 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:11.364000 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:14.458872 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:14.458841 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:14.557127 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:14.557092 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:15.274784 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:15.274735 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:15.376649 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:15.376619 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:16.245188 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:16.245156 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:16.346985 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:16.346951 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:18.809470 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:18.809438 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:18.812150 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:18.812127 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zf6fr"] Jul 06 21:06:18.814248 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:18.814234 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zf6fr" Jul 06 21:06:18.817888 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:18.817869 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 21:06:18.818018 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:18.818002 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 06 21:06:18.819072 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:18.819055 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 21:06:18.830977 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:18.830950 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 06 21:06:18.831122 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:18.831103 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f6h6j\"" Jul 06 21:06:18.832910 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:18.832894 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zf6fr"] Jul 06 21:06:18.900802 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:18.900778 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2a4b9ef-8333-41d5-9f82-c395f31376b8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zf6fr\" (UID: \"d2a4b9ef-8333-41d5-9f82-c395f31376b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zf6fr" Jul 06 21:06:18.900912 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:18.900812 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d2a4b9ef-8333-41d5-9f82-c395f31376b8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zf6fr\" (UID: \"d2a4b9ef-8333-41d5-9f82-c395f31376b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zf6fr" Jul 06 21:06:18.900912 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:18.900843 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rgn9\" (UniqueName: \"kubernetes.io/projected/d2a4b9ef-8333-41d5-9f82-c395f31376b8-kube-api-access-8rgn9\") pod \"kuadrant-console-plugin-66b5774985-zf6fr\" (UID: \"d2a4b9ef-8333-41d5-9f82-c395f31376b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zf6fr" Jul 06 21:06:19.001433 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:19.001407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2a4b9ef-8333-41d5-9f82-c395f31376b8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zf6fr\" (UID: \"d2a4b9ef-8333-41d5-9f82-c395f31376b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zf6fr" Jul 06 21:06:19.001587 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:19.001445 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d2a4b9ef-8333-41d5-9f82-c395f31376b8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zf6fr\" (UID: \"d2a4b9ef-8333-41d5-9f82-c395f31376b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zf6fr" Jul 06 21:06:19.001587 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:19.001481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rgn9\" (UniqueName: \"kubernetes.io/projected/d2a4b9ef-8333-41d5-9f82-c395f31376b8-kube-api-access-8rgn9\") pod \"kuadrant-console-plugin-66b5774985-zf6fr\" (UID: \"d2a4b9ef-8333-41d5-9f82-c395f31376b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zf6fr" Jul 06 21:06:19.001587 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:06:19.001568 2564 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 06 21:06:19.001686 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:06:19.001648 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2a4b9ef-8333-41d5-9f82-c395f31376b8-plugin-serving-cert podName:d2a4b9ef-8333-41d5-9f82-c395f31376b8 nodeName:}" failed. No retries permitted until 2026-07-06 21:06:19.501630104 +0000 UTC m=+475.030477890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/d2a4b9ef-8333-41d5-9f82-c395f31376b8-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-zf6fr" (UID: "d2a4b9ef-8333-41d5-9f82-c395f31376b8") : secret "plugin-serving-cert" not found Jul 06 21:06:19.002093 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:19.002076 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d2a4b9ef-8333-41d5-9f82-c395f31376b8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zf6fr\" (UID: \"d2a4b9ef-8333-41d5-9f82-c395f31376b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zf6fr" Jul 06 21:06:19.013099 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:19.013073 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rgn9\" (UniqueName: \"kubernetes.io/projected/d2a4b9ef-8333-41d5-9f82-c395f31376b8-kube-api-access-8rgn9\") pod \"kuadrant-console-plugin-66b5774985-zf6fr\" (UID: \"d2a4b9ef-8333-41d5-9f82-c395f31376b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zf6fr" Jul 06 21:06:19.093089 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:19.093006 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:19.504814 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:19.504722 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2a4b9ef-8333-41d5-9f82-c395f31376b8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zf6fr\" (UID: \"d2a4b9ef-8333-41d5-9f82-c395f31376b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zf6fr" Jul 06 21:06:19.507556 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:19.507537 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2a4b9ef-8333-41d5-9f82-c395f31376b8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zf6fr\" (UID: \"d2a4b9ef-8333-41d5-9f82-c395f31376b8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zf6fr" Jul 06 21:06:19.723276 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:19.723242 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zf6fr" Jul 06 21:06:19.860194 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:19.860171 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zf6fr"] Jul 06 21:06:19.862126 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:06:19.862099 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2a4b9ef_8333_41d5_9f82_c395f31376b8.slice/crio-8e12af91c53de861a4433eccef0511ecfc6501b5199fb2b6bdd51e73a499f23d WatchSource:0}: Error finding container 8e12af91c53de861a4433eccef0511ecfc6501b5199fb2b6bdd51e73a499f23d: Status 404 returned error can't find the container with id 8e12af91c53de861a4433eccef0511ecfc6501b5199fb2b6bdd51e73a499f23d Jul 06 21:06:20.091996 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:20.091964 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zf6fr" event={"ID":"d2a4b9ef-8333-41d5-9f82-c395f31376b8","Type":"ContainerStarted","Data":"8e12af91c53de861a4433eccef0511ecfc6501b5199fb2b6bdd51e73a499f23d"} Jul 06 21:06:20.596153 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:20.596108 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:20.695627 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:20.695590 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:26.803600 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:26.803562 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:26.906805 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:26.906766 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:28.433321 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:28.433283 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq"] Jul 06 21:06:28.440251 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:28.440221 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq" Jul 06 21:06:28.444633 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:28.444609 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kvxqb\"" Jul 06 21:06:28.462546 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:28.462518 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq"] Jul 06 21:06:28.473030 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:28.473004 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttrk4\" (UniqueName: \"kubernetes.io/projected/ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d-kube-api-access-ttrk4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9mnjq\" (UID: \"ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq" Jul 06 21:06:28.473158 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:28.473075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9mnjq\" (UID: \"ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq" Jul 06 21:06:28.573704 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:28.573661 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttrk4\" (UniqueName: \"kubernetes.io/projected/ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d-kube-api-access-ttrk4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9mnjq\" (UID: \"ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq" Jul 06 21:06:28.573889 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:28.573721 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9mnjq\" (UID: \"ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq" Jul 06 21:06:28.574227 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:28.574198 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9mnjq\" (UID: \"ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq" Jul 06 21:06:28.593823 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:28.593795 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttrk4\" (UniqueName: \"kubernetes.io/projected/ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d-kube-api-access-ttrk4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9mnjq\" (UID: \"ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq" Jul 06 21:06:28.751805 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:28.751721 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq" Jul 06 21:06:29.170652 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:29.170620 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq"] Jul 06 21:06:29.178324 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:29.178290 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq"] Jul 06 21:06:29.243907 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:29.243873 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2"] Jul 06 21:06:29.253527 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:29.253480 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2" Jul 06 21:06:29.268210 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:29.268184 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2"] Jul 06 21:06:29.278975 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:29.278930 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvzng\" (UniqueName: \"kubernetes.io/projected/0b135a0c-4533-4fab-bb0b-d87cb32415c8-kube-api-access-bvzng\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qlzk2\" (UID: \"0b135a0c-4533-4fab-bb0b-d87cb32415c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2" Jul 06 21:06:29.279104 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:29.279009 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b135a0c-4533-4fab-bb0b-d87cb32415c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qlzk2\" (UID: \"0b135a0c-4533-4fab-bb0b-d87cb32415c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2" Jul 06 21:06:29.379702 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:29.379669 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvzng\" (UniqueName: \"kubernetes.io/projected/0b135a0c-4533-4fab-bb0b-d87cb32415c8-kube-api-access-bvzng\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qlzk2\" (UID: \"0b135a0c-4533-4fab-bb0b-d87cb32415c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2" Jul 06 21:06:29.379894 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:29.379731 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b135a0c-4533-4fab-bb0b-d87cb32415c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qlzk2\" (UID: \"0b135a0c-4533-4fab-bb0b-d87cb32415c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2" Jul 06 21:06:29.380167 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:29.380144 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b135a0c-4533-4fab-bb0b-d87cb32415c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qlzk2\" (UID: \"0b135a0c-4533-4fab-bb0b-d87cb32415c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2" Jul 06 21:06:29.391056 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:29.391031 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvzng\" (UniqueName: \"kubernetes.io/projected/0b135a0c-4533-4fab-bb0b-d87cb32415c8-kube-api-access-bvzng\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qlzk2\" (UID: \"0b135a0c-4533-4fab-bb0b-d87cb32415c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2" Jul 06 21:06:29.567007 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:29.566967 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2" Jul 06 21:06:30.815337 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:30.815292 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:30.906014 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:30.905983 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:31.433028 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:31.432984 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:31.527918 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:31.527886 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:33.416760 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:33.416716 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:33.482671 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:33.482623 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:35.219765 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:35.219736 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:35.321173 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:35.321130 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:38.803921 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:38.803888 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:38.903955 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:38.903922 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:41.372714 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:41.372675 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2"] Jul 06 21:06:41.533210 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:41.533188 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2"] Jul 06 21:06:41.534949 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:06:41.534920 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b135a0c_4533_4fab_bb0b_d87cb32415c8.slice/crio-ffb6a1b89bf19bd0a19226258a9d18ac4350c112c13bff295775deed0b885faf WatchSource:0}: Error finding container ffb6a1b89bf19bd0a19226258a9d18ac4350c112c13bff295775deed0b885faf: Status 404 returned error can't find the container with id ffb6a1b89bf19bd0a19226258a9d18ac4350c112c13bff295775deed0b885faf Jul 06 21:06:42.214767 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:42.214735 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2" event={"ID":"0b135a0c-4533-4fab-bb0b-d87cb32415c8","Type":"ContainerStarted","Data":"ffb6a1b89bf19bd0a19226258a9d18ac4350c112c13bff295775deed0b885faf"} Jul 06 21:06:42.216394 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:42.216350 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zf6fr" event={"ID":"d2a4b9ef-8333-41d5-9f82-c395f31376b8","Type":"ContainerStarted","Data":"46c53c6568a63c1464fc3711fbc5eeff58a77da070118ec799bab6a6a2a8bc29"} Jul 06 21:06:42.251044 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:42.250988 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zf6fr" podStartSLOduration=2.643428774 podStartE2EDuration="24.250971114s" totalImagesPullingTime="21.60754234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:06:42.250348696 +0000 UTC m=+497.779196509" watchObservedRunningTime="2026-07-06 21:06:42.250971114 +0000 UTC m=+497.779818913" Jul 06 21:06:43.931947 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:06:43.931893 2564 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-9mnjq_kuadrant-system_ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d_0(47e1f4483a0daecd105600c486d794bf153950a980516a4c4ddd192f6aa09dce): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-9mnjq to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jul 06 21:06:43.932201 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:06:43.931985 2564 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-9mnjq_kuadrant-system_ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d_0(47e1f4483a0daecd105600c486d794bf153950a980516a4c4ddd192f6aa09dce): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-9mnjq to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq" Jul 06 21:06:44.225218 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:44.225149 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq" Jul 06 21:06:44.227856 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:06:44.227817 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9mnjq\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq" Jul 06 21:06:44.233108 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:44.233088 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq" Jul 06 21:06:44.235532 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:06:44.235492 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9mnjq\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq" Jul 06 21:06:44.318203 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:44.318176 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttrk4\" (UniqueName: \"kubernetes.io/projected/ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d-kube-api-access-ttrk4\") pod \"ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d\" (UID: \"ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d\") " Jul 06 21:06:44.318323 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:44.318250 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d-extensions-socket-volume\") pod \"ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d\" (UID: \"ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d\") " Jul 06 21:06:44.318515 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:44.318476 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d" (UID: "ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:06:44.320456 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:44.320434 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d-kube-api-access-ttrk4" (OuterVolumeSpecName: "kube-api-access-ttrk4") pod "ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d" (UID: "ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d"). InnerVolumeSpecName "kube-api-access-ttrk4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:06:44.419142 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:44.419110 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttrk4\" (UniqueName: \"kubernetes.io/projected/ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d-kube-api-access-ttrk4\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:06:44.419142 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:44.419137 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d-extensions-socket-volume\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:06:45.027534 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:06:45.027482 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9mnjq\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq" Jul 06 21:06:45.029967 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:45.029941 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d" path="/var/lib/kubelet/pods/ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d/volumes" Jul 06 21:06:45.230691 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:45.230665 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq" Jul 06 21:06:45.233485 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:06:45.233458 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9mnjq\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq" Jul 06 21:06:45.235685 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:06:45.235663 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9mnjq\" is forbidden: User \"system:node:ip-10-0-131-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-226.ec2.internal' and this object" podUID="ae84ccc5-fbc7-4d73-95e9-03da9f0ff83d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9mnjq" Jul 06 21:06:45.652671 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:45.652639 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:45.752540 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:45.752483 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:48.245572 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:48.245539 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2" event={"ID":"0b135a0c-4533-4fab-bb0b-d87cb32415c8","Type":"ContainerStarted","Data":"52ac6413aa22cbbbe82336dc94e2eda20a174ba4784448070427485ee32fc102"} Jul 06 21:06:48.245994 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:48.245602 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2" podUID="0b135a0c-4533-4fab-bb0b-d87cb32415c8" containerName="manager" containerID="cri-o://52ac6413aa22cbbbe82336dc94e2eda20a174ba4784448070427485ee32fc102" gracePeriod=10 Jul 06 21:06:48.245994 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:48.245711 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2" Jul 06 21:06:48.273566 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:48.273519 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2" podStartSLOduration=12.777748055 podStartE2EDuration="19.273484672s" totalImagesPullingTime="6.495736617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:06:48.270929027 +0000 UTC m=+503.799776837" watchObservedRunningTime="2026-07-06 21:06:48.273484672 +0000 UTC m=+503.802332472" Jul 06 21:06:48.527867 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:48.527839 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2" Jul 06 21:06:48.658889 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:48.658813 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvzng\" (UniqueName: \"kubernetes.io/projected/0b135a0c-4533-4fab-bb0b-d87cb32415c8-kube-api-access-bvzng\") pod \"0b135a0c-4533-4fab-bb0b-d87cb32415c8\" (UID: \"0b135a0c-4533-4fab-bb0b-d87cb32415c8\") " Jul 06 21:06:48.659032 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:48.658901 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b135a0c-4533-4fab-bb0b-d87cb32415c8-extensions-socket-volume\") pod \"0b135a0c-4533-4fab-bb0b-d87cb32415c8\" (UID: \"0b135a0c-4533-4fab-bb0b-d87cb32415c8\") " Jul 06 21:06:48.659199 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:48.659169 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b135a0c-4533-4fab-bb0b-d87cb32415c8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0b135a0c-4533-4fab-bb0b-d87cb32415c8" (UID: "0b135a0c-4533-4fab-bb0b-d87cb32415c8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:06:48.661173 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:48.661135 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b135a0c-4533-4fab-bb0b-d87cb32415c8-kube-api-access-bvzng" (OuterVolumeSpecName: "kube-api-access-bvzng") pod "0b135a0c-4533-4fab-bb0b-d87cb32415c8" (UID: "0b135a0c-4533-4fab-bb0b-d87cb32415c8"). InnerVolumeSpecName "kube-api-access-bvzng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:06:48.760230 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:48.760196 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvzng\" (UniqueName: \"kubernetes.io/projected/0b135a0c-4533-4fab-bb0b-d87cb32415c8-kube-api-access-bvzng\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:06:48.760230 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:48.760224 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b135a0c-4533-4fab-bb0b-d87cb32415c8-extensions-socket-volume\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:06:49.251122 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:49.251088 2564 generic.go:356] "Generic (PLEG): container finished" podID="0b135a0c-4533-4fab-bb0b-d87cb32415c8" containerID="52ac6413aa22cbbbe82336dc94e2eda20a174ba4784448070427485ee32fc102" exitCode=2 Jul 06 21:06:49.251606 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:49.251141 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2" Jul 06 21:06:49.251606 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:49.251181 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2" event={"ID":"0b135a0c-4533-4fab-bb0b-d87cb32415c8","Type":"ContainerDied","Data":"52ac6413aa22cbbbe82336dc94e2eda20a174ba4784448070427485ee32fc102"} Jul 06 21:06:49.251606 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:49.251247 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2" event={"ID":"0b135a0c-4533-4fab-bb0b-d87cb32415c8","Type":"ContainerDied","Data":"ffb6a1b89bf19bd0a19226258a9d18ac4350c112c13bff295775deed0b885faf"} Jul 06 21:06:49.251776 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:49.251655 2564 scope.go:117] "RemoveContainer" containerID="52ac6413aa22cbbbe82336dc94e2eda20a174ba4784448070427485ee32fc102" Jul 06 21:06:49.264891 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:49.264874 2564 scope.go:117] "RemoveContainer" containerID="52ac6413aa22cbbbe82336dc94e2eda20a174ba4784448070427485ee32fc102" Jul 06 21:06:49.265149 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:06:49.265132 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52ac6413aa22cbbbe82336dc94e2eda20a174ba4784448070427485ee32fc102\": container with ID starting with 52ac6413aa22cbbbe82336dc94e2eda20a174ba4784448070427485ee32fc102 not found: ID does not exist" containerID="52ac6413aa22cbbbe82336dc94e2eda20a174ba4784448070427485ee32fc102" Jul 06 21:06:49.265192 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:49.265157 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52ac6413aa22cbbbe82336dc94e2eda20a174ba4784448070427485ee32fc102"} err="failed to get container status \"52ac6413aa22cbbbe82336dc94e2eda20a174ba4784448070427485ee32fc102\": rpc error: code = NotFound desc = could not find container \"52ac6413aa22cbbbe82336dc94e2eda20a174ba4784448070427485ee32fc102\": container with ID starting with 52ac6413aa22cbbbe82336dc94e2eda20a174ba4784448070427485ee32fc102 not found: ID does not exist" Jul 06 21:06:49.273379 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:49.273359 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2"] Jul 06 21:06:49.277980 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:49.277959 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qlzk2"] Jul 06 21:06:51.015647 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:51.015611 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:51.028976 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:51.028948 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b135a0c-4533-4fab-bb0b-d87cb32415c8" path="/var/lib/kubelet/pods/0b135a0c-4533-4fab-bb0b-d87cb32415c8/volumes" Jul 06 21:06:51.121783 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:51.121747 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:51.232961 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:51.232923 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:51.318745 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:51.318718 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:51.754675 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:51.754596 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:51.833422 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:51.833390 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:57.159301 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:57.159266 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:57.260215 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:57.260178 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:57.881064 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:57.881030 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:06:58.048573 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:06:58.048535 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:07:02.385966 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:02.385932 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:07:02.486547 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:02.486490 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:07:02.587752 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:02.587717 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:07:16.378159 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:16.378076 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:07:16.490979 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:16.490946 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:07:16.545693 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:16.545658 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:07:16.732541 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:16.732441 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:07:16.732806 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:16.732792 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b135a0c-4533-4fab-bb0b-d87cb32415c8" containerName="manager" Jul 06 21:07:16.732852 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:16.732808 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b135a0c-4533-4fab-bb0b-d87cb32415c8" containerName="manager" Jul 06 21:07:16.732899 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:16.732859 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b135a0c-4533-4fab-bb0b-d87cb32415c8" containerName="manager" Jul 06 21:07:16.769791 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:16.769757 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:07:16.769791 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:16.769796 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:07:16.769981 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:16.769868 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nmc6h" Jul 06 21:07:16.772579 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:16.772554 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 21:07:16.790456 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:16.790420 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-594wl\" (UniqueName: \"kubernetes.io/projected/57ba510c-3a32-4c0d-9ca8-3a22de30fed5-kube-api-access-594wl\") pod \"limitador-limitador-54d6d988d5-nmc6h\" (UID: \"57ba510c-3a32-4c0d-9ca8-3a22de30fed5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nmc6h" Jul 06 21:07:16.790612 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:16.790556 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57ba510c-3a32-4c0d-9ca8-3a22de30fed5-config-file\") pod \"limitador-limitador-54d6d988d5-nmc6h\" (UID: \"57ba510c-3a32-4c0d-9ca8-3a22de30fed5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nmc6h" Jul 06 21:07:16.891311 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:16.891271 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57ba510c-3a32-4c0d-9ca8-3a22de30fed5-config-file\") pod \"limitador-limitador-54d6d988d5-nmc6h\" (UID: \"57ba510c-3a32-4c0d-9ca8-3a22de30fed5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nmc6h" Jul 06 21:07:16.891530 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:16.891357 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-594wl\" (UniqueName: \"kubernetes.io/projected/57ba510c-3a32-4c0d-9ca8-3a22de30fed5-kube-api-access-594wl\") pod \"limitador-limitador-54d6d988d5-nmc6h\" (UID: \"57ba510c-3a32-4c0d-9ca8-3a22de30fed5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nmc6h" Jul 06 21:07:16.891920 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:16.891898 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57ba510c-3a32-4c0d-9ca8-3a22de30fed5-config-file\") pod \"limitador-limitador-54d6d988d5-nmc6h\" (UID: \"57ba510c-3a32-4c0d-9ca8-3a22de30fed5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nmc6h" Jul 06 21:07:16.903564 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:16.903539 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-594wl\" (UniqueName: \"kubernetes.io/projected/57ba510c-3a32-4c0d-9ca8-3a22de30fed5-kube-api-access-594wl\") pod \"limitador-limitador-54d6d988d5-nmc6h\" (UID: \"57ba510c-3a32-4c0d-9ca8-3a22de30fed5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nmc6h" Jul 06 21:07:17.080186 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:17.080154 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nmc6h" Jul 06 21:07:17.225174 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:17.225148 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:07:17.227608 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:07:17.227570 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ba510c_3a32_4c0d_9ca8_3a22de30fed5.slice/crio-eeffb597acf218ee05215d9ddc264a8fb4acbc927a07b825db9dac0a2b812e59 WatchSource:0}: Error finding container eeffb597acf218ee05215d9ddc264a8fb4acbc927a07b825db9dac0a2b812e59: Status 404 returned error can't find the container with id eeffb597acf218ee05215d9ddc264a8fb4acbc927a07b825db9dac0a2b812e59 Jul 06 21:07:17.299597 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:17.299565 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-4glz9"] Jul 06 21:07:17.310591 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:17.310572 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4glz9" Jul 06 21:07:17.313699 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:17.313680 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gclwr\"" Jul 06 21:07:17.317252 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:17.317224 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4glz9"] Jul 06 21:07:17.335283 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:17.335229 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:07:17.373562 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:17.373526 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nmc6h" event={"ID":"57ba510c-3a32-4c0d-9ca8-3a22de30fed5","Type":"ContainerStarted","Data":"eeffb597acf218ee05215d9ddc264a8fb4acbc927a07b825db9dac0a2b812e59"} Jul 06 21:07:17.394976 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:17.394947 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:07:17.395394 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:17.395083 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf7xl\" (UniqueName: \"kubernetes.io/projected/b6e82270-bc21-445f-ab68-bdd1c825a7a7-kube-api-access-jf7xl\") pod \"authorino-58cd955675-4glz9\" (UID: \"b6e82270-bc21-445f-ab68-bdd1c825a7a7\") " pod="kuadrant-system/authorino-58cd955675-4glz9" Jul 06 21:07:17.496104 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:17.496069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf7xl\" (UniqueName: \"kubernetes.io/projected/b6e82270-bc21-445f-ab68-bdd1c825a7a7-kube-api-access-jf7xl\") pod \"authorino-58cd955675-4glz9\" (UID: \"b6e82270-bc21-445f-ab68-bdd1c825a7a7\") " pod="kuadrant-system/authorino-58cd955675-4glz9" Jul 06 21:07:17.508460 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:17.508424 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf7xl\" (UniqueName: \"kubernetes.io/projected/b6e82270-bc21-445f-ab68-bdd1c825a7a7-kube-api-access-jf7xl\") pod \"authorino-58cd955675-4glz9\" (UID: \"b6e82270-bc21-445f-ab68-bdd1c825a7a7\") " pod="kuadrant-system/authorino-58cd955675-4glz9" Jul 06 21:07:17.620482 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:17.620417 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4glz9" Jul 06 21:07:17.785074 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:17.785042 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4glz9"] Jul 06 21:07:17.788259 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:07:17.788233 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6e82270_bc21_445f_ab68_bdd1c825a7a7.slice/crio-6f17eccd5fdec5cb22c27d2eec404f6bcaba5df299bcc6fc0e370ab0d004c4b3 WatchSource:0}: Error finding container 6f17eccd5fdec5cb22c27d2eec404f6bcaba5df299bcc6fc0e370ab0d004c4b3: Status 404 returned error can't find the container with id 6f17eccd5fdec5cb22c27d2eec404f6bcaba5df299bcc6fc0e370ab0d004c4b3 Jul 06 21:07:18.380291 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:18.380251 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4glz9" event={"ID":"b6e82270-bc21-445f-ab68-bdd1c825a7a7","Type":"ContainerStarted","Data":"6f17eccd5fdec5cb22c27d2eec404f6bcaba5df299bcc6fc0e370ab0d004c4b3"} Jul 06 21:07:18.677365 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:18.677281 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:07:22.403584 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:22.403553 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4glz9" event={"ID":"b6e82270-bc21-445f-ab68-bdd1c825a7a7","Type":"ContainerStarted","Data":"b601cee85393b00cf727203fc995f58f3e626477a2d75bdb1a610d3cfc535f1c"} Jul 06 21:07:22.405006 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:22.404981 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nmc6h" event={"ID":"57ba510c-3a32-4c0d-9ca8-3a22de30fed5","Type":"ContainerStarted","Data":"706fdee76f2edadd23019c22f02494a5fa2d9b4f53052f6c9ab2a069289cc120"} Jul 06 21:07:22.405116 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:22.405028 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nmc6h" Jul 06 21:07:22.423788 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:22.423747 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-4glz9" podStartSLOduration=1.186133538 podStartE2EDuration="5.423733296s" totalImagesPullingTime="4.237599758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:07:22.422009462 +0000 UTC m=+537.950857261" watchObservedRunningTime="2026-07-06 21:07:22.423733296 +0000 UTC m=+537.952581095" Jul 06 21:07:22.449005 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:22.448958 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-nmc6h" podStartSLOduration=1.657727429 podStartE2EDuration="6.44894436s" totalImagesPullingTime="4.791216931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:07:22.446862554 +0000 UTC m=+537.975710347" watchObservedRunningTime="2026-07-06 21:07:22.44894436 +0000 UTC m=+537.977792158" Jul 06 21:07:22.630744 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:22.630701 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4glz9"] Jul 06 21:07:24.413945 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:24.413905 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-4glz9" podUID="b6e82270-bc21-445f-ab68-bdd1c825a7a7" containerName="authorino" containerID="cri-o://b601cee85393b00cf727203fc995f58f3e626477a2d75bdb1a610d3cfc535f1c" gracePeriod=30 Jul 06 21:07:24.661454 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:24.661429 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4glz9" Jul 06 21:07:24.758482 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:24.758397 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf7xl\" (UniqueName: \"kubernetes.io/projected/b6e82270-bc21-445f-ab68-bdd1c825a7a7-kube-api-access-jf7xl\") pod \"b6e82270-bc21-445f-ab68-bdd1c825a7a7\" (UID: \"b6e82270-bc21-445f-ab68-bdd1c825a7a7\") " Jul 06 21:07:24.760806 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:24.760775 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6e82270-bc21-445f-ab68-bdd1c825a7a7-kube-api-access-jf7xl" (OuterVolumeSpecName: "kube-api-access-jf7xl") pod "b6e82270-bc21-445f-ab68-bdd1c825a7a7" (UID: "b6e82270-bc21-445f-ab68-bdd1c825a7a7"). InnerVolumeSpecName "kube-api-access-jf7xl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:07:24.859630 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:24.859600 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf7xl\" (UniqueName: \"kubernetes.io/projected/b6e82270-bc21-445f-ab68-bdd1c825a7a7-kube-api-access-jf7xl\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:07:25.419593 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:25.419480 2564 generic.go:356] "Generic (PLEG): container finished" podID="b6e82270-bc21-445f-ab68-bdd1c825a7a7" containerID="b601cee85393b00cf727203fc995f58f3e626477a2d75bdb1a610d3cfc535f1c" exitCode=0 Jul 06 21:07:25.419593 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:25.419542 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4glz9" event={"ID":"b6e82270-bc21-445f-ab68-bdd1c825a7a7","Type":"ContainerDied","Data":"b601cee85393b00cf727203fc995f58f3e626477a2d75bdb1a610d3cfc535f1c"} Jul 06 21:07:25.419593 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:25.419546 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4glz9" Jul 06 21:07:25.419593 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:25.419575 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4glz9" event={"ID":"b6e82270-bc21-445f-ab68-bdd1c825a7a7","Type":"ContainerDied","Data":"6f17eccd5fdec5cb22c27d2eec404f6bcaba5df299bcc6fc0e370ab0d004c4b3"} Jul 06 21:07:25.419593 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:25.419595 2564 scope.go:117] "RemoveContainer" containerID="b601cee85393b00cf727203fc995f58f3e626477a2d75bdb1a610d3cfc535f1c" Jul 06 21:07:25.427880 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:25.427833 2564 scope.go:117] "RemoveContainer" containerID="b601cee85393b00cf727203fc995f58f3e626477a2d75bdb1a610d3cfc535f1c" Jul 06 21:07:25.428112 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:07:25.428094 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b601cee85393b00cf727203fc995f58f3e626477a2d75bdb1a610d3cfc535f1c\": container with ID starting with b601cee85393b00cf727203fc995f58f3e626477a2d75bdb1a610d3cfc535f1c not found: ID does not exist" containerID="b601cee85393b00cf727203fc995f58f3e626477a2d75bdb1a610d3cfc535f1c" Jul 06 21:07:25.428155 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:25.428120 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b601cee85393b00cf727203fc995f58f3e626477a2d75bdb1a610d3cfc535f1c"} err="failed to get container status \"b601cee85393b00cf727203fc995f58f3e626477a2d75bdb1a610d3cfc535f1c\": rpc error: code = NotFound desc = could not find container \"b601cee85393b00cf727203fc995f58f3e626477a2d75bdb1a610d3cfc535f1c\": container with ID starting with b601cee85393b00cf727203fc995f58f3e626477a2d75bdb1a610d3cfc535f1c not found: ID does not exist" Jul 06 21:07:25.442404 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:25.442375 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4glz9"] Jul 06 21:07:25.447908 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:25.447883 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-4glz9"] Jul 06 21:07:27.029219 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:27.029187 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6e82270-bc21-445f-ab68-bdd1c825a7a7" path="/var/lib/kubelet/pods/b6e82270-bc21-445f-ab68-bdd1c825a7a7/volumes" Jul 06 21:07:33.410305 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:33.410271 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nmc6h" Jul 06 21:07:36.716779 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:36.716748 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:07:50.064325 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:50.064287 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:07:50.851987 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:50.851955 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:07:56.349456 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:56.349417 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:07:56.433667 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:56.433634 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:07:56.499719 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:56.499686 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:07:56.566306 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:56.566277 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:07:59.340911 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:59.340879 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:07:59.432181 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:07:59.432146 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:08:19.171615 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:08:19.171581 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:08:19.232973 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:08:19.232949 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:08:24.988099 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:08:24.988067 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:08:24.990175 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:08:24.990149 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:08:24.991649 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:08:24.991631 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 21:08:24.993607 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:08:24.993589 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 21:08:24.999214 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:08:24.999194 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 21:08:25.000966 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:08:25.000952 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 21:08:33.631815 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:08:33.631775 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:08:34.697284 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:08:34.697243 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:08:34.784683 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:08:34.784640 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:08:34.897967 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:08:34.897932 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:08:45.017866 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:08:45.017833 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:08:45.110180 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:08:45.110139 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:08:47.853271 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:08:47.853191 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:08:50.270979 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:08:50.270935 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:08:50.589612 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:08:50.589577 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:09:00.543133 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:00.543090 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:09:04.089330 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:04.089292 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:09:04.849811 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:04.849769 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:09:10.897093 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:10.897057 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:09:24.383251 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:24.383220 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:09:25.552687 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:25.552654 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:09:28.268810 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:28.268773 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:09:30.253260 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:30.253230 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:09:32.351573 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.351537 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l"] Jul 06 21:09:32.351945 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.351882 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6e82270-bc21-445f-ab68-bdd1c825a7a7" containerName="authorino" Jul 06 21:09:32.351945 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.351896 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6e82270-bc21-445f-ab68-bdd1c825a7a7" containerName="authorino" Jul 06 21:09:32.352024 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.351969 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6e82270-bc21-445f-ab68-bdd1c825a7a7" containerName="authorino" Jul 06 21:09:32.353979 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.353963 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.357403 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.357377 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6lnnj\"" Jul 06 21:09:32.357562 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.357377 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 21:09:32.357562 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.357376 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 21:09:32.357562 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.357510 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 06 21:09:32.365962 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.365942 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l"] Jul 06 21:09:32.376445 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.376426 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62d77b0f-0a49-4247-8a08-a0dd2e80c37f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-np77l\" (UID: \"62d77b0f-0a49-4247-8a08-a0dd2e80c37f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.376688 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.376453 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5w7d\" (UniqueName: \"kubernetes.io/projected/62d77b0f-0a49-4247-8a08-a0dd2e80c37f-kube-api-access-x5w7d\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-np77l\" (UID: \"62d77b0f-0a49-4247-8a08-a0dd2e80c37f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.376688 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.376475 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62d77b0f-0a49-4247-8a08-a0dd2e80c37f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-np77l\" (UID: \"62d77b0f-0a49-4247-8a08-a0dd2e80c37f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.376688 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.376561 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62d77b0f-0a49-4247-8a08-a0dd2e80c37f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-np77l\" (UID: \"62d77b0f-0a49-4247-8a08-a0dd2e80c37f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.376688 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.376591 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62d77b0f-0a49-4247-8a08-a0dd2e80c37f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-np77l\" (UID: \"62d77b0f-0a49-4247-8a08-a0dd2e80c37f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.376688 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.376612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62d77b0f-0a49-4247-8a08-a0dd2e80c37f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-np77l\" (UID: \"62d77b0f-0a49-4247-8a08-a0dd2e80c37f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.451406 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.451377 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:09:32.477797 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.477773 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62d77b0f-0a49-4247-8a08-a0dd2e80c37f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-np77l\" (UID: \"62d77b0f-0a49-4247-8a08-a0dd2e80c37f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.477889 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.477809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62d77b0f-0a49-4247-8a08-a0dd2e80c37f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-np77l\" (UID: \"62d77b0f-0a49-4247-8a08-a0dd2e80c37f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.477889 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.477861 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62d77b0f-0a49-4247-8a08-a0dd2e80c37f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-np77l\" (UID: \"62d77b0f-0a49-4247-8a08-a0dd2e80c37f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.477961 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.477887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5w7d\" (UniqueName: \"kubernetes.io/projected/62d77b0f-0a49-4247-8a08-a0dd2e80c37f-kube-api-access-x5w7d\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-np77l\" (UID: \"62d77b0f-0a49-4247-8a08-a0dd2e80c37f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.477961 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.477917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62d77b0f-0a49-4247-8a08-a0dd2e80c37f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-np77l\" (UID: \"62d77b0f-0a49-4247-8a08-a0dd2e80c37f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.478035 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.477981 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62d77b0f-0a49-4247-8a08-a0dd2e80c37f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-np77l\" (UID: \"62d77b0f-0a49-4247-8a08-a0dd2e80c37f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.478227 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.478196 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62d77b0f-0a49-4247-8a08-a0dd2e80c37f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-np77l\" (UID: \"62d77b0f-0a49-4247-8a08-a0dd2e80c37f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.478337 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.478284 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62d77b0f-0a49-4247-8a08-a0dd2e80c37f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-np77l\" (UID: \"62d77b0f-0a49-4247-8a08-a0dd2e80c37f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.478337 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.478316 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62d77b0f-0a49-4247-8a08-a0dd2e80c37f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-np77l\" (UID: \"62d77b0f-0a49-4247-8a08-a0dd2e80c37f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.480290 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.480272 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62d77b0f-0a49-4247-8a08-a0dd2e80c37f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-np77l\" (UID: \"62d77b0f-0a49-4247-8a08-a0dd2e80c37f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.480561 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.480544 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62d77b0f-0a49-4247-8a08-a0dd2e80c37f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-np77l\" (UID: \"62d77b0f-0a49-4247-8a08-a0dd2e80c37f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.488106 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.488080 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5w7d\" (UniqueName: \"kubernetes.io/projected/62d77b0f-0a49-4247-8a08-a0dd2e80c37f-kube-api-access-x5w7d\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-np77l\" (UID: \"62d77b0f-0a49-4247-8a08-a0dd2e80c37f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.663928 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.663846 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:32.796712 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.796687 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l"] Jul 06 21:09:32.799235 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:09:32.799201 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d77b0f_0a49_4247_8a08_a0dd2e80c37f.slice/crio-30d3c17bc8d36444b0e7f452dbd04ab2a662a119b0e9cfab24d25e8c2b030fe9 WatchSource:0}: Error finding container 30d3c17bc8d36444b0e7f452dbd04ab2a662a119b0e9cfab24d25e8c2b030fe9: Status 404 returned error can't find the container with id 30d3c17bc8d36444b0e7f452dbd04ab2a662a119b0e9cfab24d25e8c2b030fe9 Jul 06 21:09:32.800707 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.800687 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 21:09:32.978731 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:32.978654 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" event={"ID":"62d77b0f-0a49-4247-8a08-a0dd2e80c37f","Type":"ContainerStarted","Data":"30d3c17bc8d36444b0e7f452dbd04ab2a662a119b0e9cfab24d25e8c2b030fe9"} Jul 06 21:09:33.985663 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:33.985626 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" event={"ID":"62d77b0f-0a49-4247-8a08-a0dd2e80c37f","Type":"ContainerStarted","Data":"8f26141c818af801bef8229ba68a5d56b0f0f16cc9c137aabf3105594e90fda6"} Jul 06 21:09:38.453404 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:38.453351 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" podStartSLOduration=5.389276766 podStartE2EDuration="6.453333757s" totalImagesPullingTime="1.064056991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:09:34.008161654 +0000 UTC m=+669.537009455" watchObservedRunningTime="2026-07-06 21:09:38.453333757 +0000 UTC m=+673.982181563" Jul 06 21:09:38.454362 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:38.454345 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:09:42.664494 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:42.664456 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:42.664911 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:42.664541 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:42.677047 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:42.677021 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:43.036313 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:43.036286 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-np77l" Jul 06 21:09:57.553147 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.553116 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj"] Jul 06 21:09:57.555471 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.555454 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.558060 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.558041 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 06 21:09:57.566328 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.566303 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj"] Jul 06 21:09:57.577538 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.577494 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:09:57.692299 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.692267 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c01791a0-180b-4542-8735-4897143b180c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj\" (UID: \"c01791a0-180b-4542-8735-4897143b180c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.692466 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.692318 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c01791a0-180b-4542-8735-4897143b180c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj\" (UID: \"c01791a0-180b-4542-8735-4897143b180c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.692466 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.692384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c01791a0-180b-4542-8735-4897143b180c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj\" (UID: \"c01791a0-180b-4542-8735-4897143b180c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.692466 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.692413 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ggsv\" (UniqueName: \"kubernetes.io/projected/c01791a0-180b-4542-8735-4897143b180c-kube-api-access-5ggsv\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj\" (UID: \"c01791a0-180b-4542-8735-4897143b180c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.692466 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.692442 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c01791a0-180b-4542-8735-4897143b180c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj\" (UID: \"c01791a0-180b-4542-8735-4897143b180c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.692623 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.692530 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c01791a0-180b-4542-8735-4897143b180c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj\" (UID: \"c01791a0-180b-4542-8735-4897143b180c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.793569 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.793529 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c01791a0-180b-4542-8735-4897143b180c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj\" (UID: \"c01791a0-180b-4542-8735-4897143b180c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.793569 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.793579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c01791a0-180b-4542-8735-4897143b180c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj\" (UID: \"c01791a0-180b-4542-8735-4897143b180c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.793777 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.793596 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ggsv\" (UniqueName: \"kubernetes.io/projected/c01791a0-180b-4542-8735-4897143b180c-kube-api-access-5ggsv\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj\" (UID: \"c01791a0-180b-4542-8735-4897143b180c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.793777 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.793621 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c01791a0-180b-4542-8735-4897143b180c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj\" (UID: \"c01791a0-180b-4542-8735-4897143b180c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.793777 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.793662 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c01791a0-180b-4542-8735-4897143b180c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj\" (UID: \"c01791a0-180b-4542-8735-4897143b180c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.793777 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.793692 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c01791a0-180b-4542-8735-4897143b180c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj\" (UID: \"c01791a0-180b-4542-8735-4897143b180c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.794007 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.793982 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c01791a0-180b-4542-8735-4897143b180c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj\" (UID: \"c01791a0-180b-4542-8735-4897143b180c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.794047 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.794012 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c01791a0-180b-4542-8735-4897143b180c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj\" (UID: \"c01791a0-180b-4542-8735-4897143b180c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.794087 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.794045 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c01791a0-180b-4542-8735-4897143b180c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj\" (UID: \"c01791a0-180b-4542-8735-4897143b180c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.796054 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.796034 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c01791a0-180b-4542-8735-4897143b180c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj\" (UID: \"c01791a0-180b-4542-8735-4897143b180c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.796315 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.796298 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c01791a0-180b-4542-8735-4897143b180c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj\" (UID: \"c01791a0-180b-4542-8735-4897143b180c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.802958 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.802928 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ggsv\" (UniqueName: \"kubernetes.io/projected/c01791a0-180b-4542-8735-4897143b180c-kube-api-access-5ggsv\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj\" (UID: \"c01791a0-180b-4542-8735-4897143b180c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.863944 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.863860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:09:57.998364 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:57.998337 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj"] Jul 06 21:09:58.000050 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:09:58.000012 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc01791a0_180b_4542_8735_4897143b180c.slice/crio-dc85650568a99b3ed399cbf9e07601936222f27e19f1862d16781994bd2dc8f3 WatchSource:0}: Error finding container dc85650568a99b3ed399cbf9e07601936222f27e19f1862d16781994bd2dc8f3: Status 404 returned error can't find the container with id dc85650568a99b3ed399cbf9e07601936222f27e19f1862d16781994bd2dc8f3 Jul 06 21:09:58.087918 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:58.087884 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" event={"ID":"c01791a0-180b-4542-8735-4897143b180c","Type":"ContainerStarted","Data":"dc85650568a99b3ed399cbf9e07601936222f27e19f1862d16781994bd2dc8f3"} Jul 06 21:09:59.093988 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:59.093944 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" event={"ID":"c01791a0-180b-4542-8735-4897143b180c","Type":"ContainerStarted","Data":"c1c4a75907ab70cf998234bd12e17b1072992a144b07a8c177267c17ad7eed89"} Jul 06 21:09:59.115472 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:09:59.115423 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" podStartSLOduration=1.899146425 podStartE2EDuration="2.115404881s" totalImagesPullingTime="216.258456ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:09:59.113778609 +0000 UTC m=+694.642626408" watchObservedRunningTime="2026-07-06 21:09:59.115404881 +0000 UTC m=+694.644252680" Jul 06 21:10:00.249060 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:10:00.249024 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:10:07.864950 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:10:07.864891 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:10:07.864950 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:10:07.864962 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:10:07.877854 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:10:07.877828 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:10:08.147390 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:10:08.147321 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj" Jul 06 21:11:15.666182 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:15.666144 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68cffc5448-7pl2x"] Jul 06 21:11:15.668474 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:15.668457 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68cffc5448-7pl2x" Jul 06 21:11:15.672122 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:15.672097 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gclwr\"" Jul 06 21:11:15.672122 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:15.672117 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 06 21:11:15.678064 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:15.678043 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68cffc5448-7pl2x"] Jul 06 21:11:15.771921 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:15.771890 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7f7b1f6a-4dca-448e-aa52-654634a1c9aa-tls-cert\") pod \"authorino-68cffc5448-7pl2x\" (UID: \"7f7b1f6a-4dca-448e-aa52-654634a1c9aa\") " pod="kuadrant-system/authorino-68cffc5448-7pl2x" Jul 06 21:11:15.772083 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:15.771934 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf6f4\" (UniqueName: \"kubernetes.io/projected/7f7b1f6a-4dca-448e-aa52-654634a1c9aa-kube-api-access-mf6f4\") pod \"authorino-68cffc5448-7pl2x\" (UID: \"7f7b1f6a-4dca-448e-aa52-654634a1c9aa\") " pod="kuadrant-system/authorino-68cffc5448-7pl2x" Jul 06 21:11:15.873152 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:15.873107 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7f7b1f6a-4dca-448e-aa52-654634a1c9aa-tls-cert\") pod \"authorino-68cffc5448-7pl2x\" (UID: \"7f7b1f6a-4dca-448e-aa52-654634a1c9aa\") " pod="kuadrant-system/authorino-68cffc5448-7pl2x" Jul 06 21:11:15.873330 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:15.873179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf6f4\" (UniqueName: \"kubernetes.io/projected/7f7b1f6a-4dca-448e-aa52-654634a1c9aa-kube-api-access-mf6f4\") pod \"authorino-68cffc5448-7pl2x\" (UID: \"7f7b1f6a-4dca-448e-aa52-654634a1c9aa\") " pod="kuadrant-system/authorino-68cffc5448-7pl2x" Jul 06 21:11:15.875655 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:15.875634 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7f7b1f6a-4dca-448e-aa52-654634a1c9aa-tls-cert\") pod \"authorino-68cffc5448-7pl2x\" (UID: \"7f7b1f6a-4dca-448e-aa52-654634a1c9aa\") " pod="kuadrant-system/authorino-68cffc5448-7pl2x" Jul 06 21:11:15.882775 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:15.882749 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf6f4\" (UniqueName: \"kubernetes.io/projected/7f7b1f6a-4dca-448e-aa52-654634a1c9aa-kube-api-access-mf6f4\") pod \"authorino-68cffc5448-7pl2x\" (UID: \"7f7b1f6a-4dca-448e-aa52-654634a1c9aa\") " pod="kuadrant-system/authorino-68cffc5448-7pl2x" Jul 06 21:11:15.977197 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:15.977105 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68cffc5448-7pl2x" Jul 06 21:11:16.079406 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:16.079378 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:11:16.113116 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:16.113091 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68cffc5448-7pl2x"] Jul 06 21:11:16.115425 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:11:16.115401 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f7b1f6a_4dca_448e_aa52_654634a1c9aa.slice/crio-f37fab2fa47214aea675b2e6bd5bbccef9cc1f2d69dda673cb91b1f43f930809 WatchSource:0}: Error finding container f37fab2fa47214aea675b2e6bd5bbccef9cc1f2d69dda673cb91b1f43f930809: Status 404 returned error can't find the container with id f37fab2fa47214aea675b2e6bd5bbccef9cc1f2d69dda673cb91b1f43f930809 Jul 06 21:11:16.180540 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:16.180469 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:11:16.442292 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:16.442256 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68cffc5448-7pl2x" event={"ID":"7f7b1f6a-4dca-448e-aa52-654634a1c9aa","Type":"ContainerStarted","Data":"f37fab2fa47214aea675b2e6bd5bbccef9cc1f2d69dda673cb91b1f43f930809"} Jul 06 21:11:17.316885 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:17.316856 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:11:17.416384 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:17.416314 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:11:17.448276 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:17.448235 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68cffc5448-7pl2x" event={"ID":"7f7b1f6a-4dca-448e-aa52-654634a1c9aa","Type":"ContainerStarted","Data":"92bc52397842071bd6f2b1dc41b41daf10daec4b04bce65c7dcefe010c1e9ea8"} Jul 06 21:11:17.467361 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:17.467316 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68cffc5448-7pl2x" podStartSLOduration=1.8789104540000001 podStartE2EDuration="2.46730113s" totalImagesPullingTime="588.390676ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:11:17.465686553 +0000 UTC m=+772.994534353" watchObservedRunningTime="2026-07-06 21:11:17.46730113 +0000 UTC m=+772.996148906" Jul 06 21:11:45.763961 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:45.763927 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:11:55.652436 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:11:55.652405 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:12:06.151062 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:12:06.150335 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:12:07.543102 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:12:07.543070 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:12:07.643944 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:12:07.643917 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:12:15.276823 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:12:15.276786 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:12:26.267797 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:12:26.267766 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:12:28.628001 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:12:28.627958 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:12:29.972265 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:12:29.972231 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:12:36.729191 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:12:36.729156 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:12:53.750200 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:12:53.750156 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:13:05.548364 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:05.548328 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:13:12.041164 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:12.041121 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:13:13.370313 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:13.370276 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:13:13.469268 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:13.469230 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:13:13.613270 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:13.613231 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:13:17.655137 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:17.655060 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:13:20.252473 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:20.252438 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:13:20.358773 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:20.358740 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:13:20.452298 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:20.452258 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:13:20.600296 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:20.600259 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:13:23.054744 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:23.054711 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:13:25.016063 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:25.016033 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:13:25.018962 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:25.018939 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:13:25.020008 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:25.019984 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 21:13:25.022719 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:25.022699 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 21:13:25.027830 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:25.027811 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 21:13:25.030828 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:25.030812 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 21:13:26.422228 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:26.422183 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:13:26.521803 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:26.521769 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:13:43.240604 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:43.240565 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:13:52.987842 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:13:52.987806 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:14:01.344216 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:14:01.344181 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:14:12.362249 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:14:12.362215 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:14:21.089098 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:14:21.089051 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:14:31.056407 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:14:31.056365 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:14:42.366441 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:14:42.366409 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:14:52.058055 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:14:52.057971 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:14:54.052525 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:14:54.052469 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:15:14.969850 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:15:14.969798 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:15:23.962841 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:15:23.962806 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:15:46.083586 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:15:46.083550 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:15:46.183020 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:15:46.182987 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:15:50.182833 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:15:50.182800 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:16:00.965130 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:16:00.965096 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:16:17.462482 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:16:17.462404 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:16:26.257852 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:16:26.257819 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:16:35.253597 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:16:35.253564 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:16:45.460430 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:16:45.460392 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:16:54.260200 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:16:54.260163 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:18:25.043942 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:18:25.043909 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:18:25.047520 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:18:25.047482 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 21:18:25.049153 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:18:25.049132 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:18:25.052566 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:18:25.052549 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 21:18:25.055222 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:18:25.055204 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 21:18:25.059511 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:18:25.059479 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 21:18:44.645193 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:18:44.645154 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:18:55.948141 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:18:55.948101 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:19:06.848231 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:19:06.848190 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:19:16.257606 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:19:16.257515 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:19:33.257684 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:19:33.257637 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:19:40.580905 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:19:40.580855 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:19:43.060124 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:19:43.060080 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:19:53.451056 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:19:53.451015 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:20:03.360953 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:20:03.360916 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:20:06.128665 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:20:06.128619 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:20:13.654955 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:20:13.654918 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:20:26.249771 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:20:26.249730 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:20:33.561162 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:20:33.561124 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:20:52.049083 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:20:52.048993 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:21:00.959480 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:21:00.959444 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:21:10.462160 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:21:10.462123 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:21:22.369471 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:21:22.369432 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:21:36.042943 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:21:36.042904 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:21:38.053909 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:21:38.053872 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:21:47.286845 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:21:47.286806 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:21:56.753773 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:21:56.753739 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:22:04.373740 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:22:04.373698 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:22:13.663860 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:22:13.663828 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:22:22.959077 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:22:22.959038 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:22:28.759097 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:22:28.759056 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:22:37.761043 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:22:37.761004 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:22:47.463841 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:22:47.463802 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:22:57.083259 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:22:57.083227 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:23:11.859070 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:23:11.859028 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:23:23.973327 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:23:23.973291 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:23:25.071270 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:23:25.071245 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:23:25.074432 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:23:25.074413 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 21:23:25.078260 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:23:25.078235 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:23:25.081529 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:23:25.081491 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 21:23:25.081716 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:23:25.081699 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 21:23:25.088399 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:23:25.088382 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 21:23:31.765722 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:23:31.765679 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:23:41.960574 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:23:41.960533 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:23:53.756195 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:23:53.756114 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:24:03.252207 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:03.252172 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:24:06.017652 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:06.017620 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:12.929565 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:12.929525 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:16.063919 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:16.063883 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:24:21.418676 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:21.418638 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:24.958705 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:24.958663 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:24:26.789951 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:26.789914 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:30.187554 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:30.187518 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:30.281998 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:30.281962 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:30.745832 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:30.745795 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:34.557517 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:34.557460 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:24:37.115558 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:37.115485 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:37.180774 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:37.180730 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:37.381555 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:37.381433 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:37.480185 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:37.480141 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:38.568046 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:38.568009 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:38.657685 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:38.657640 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:38.726957 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:38.726924 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:39.207610 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:39.207569 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:39.386448 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:39.386419 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:39.485474 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:39.485380 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:40.519886 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:40.519853 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:40.582445 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:40.582409 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:41.201661 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:41.201630 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:43.719920 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:43.719890 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:43.920248 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:43.920209 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:44.048139 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:44.048105 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:44.237298 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:44.237259 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:45.402075 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:45.402043 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:50.442770 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:50.442703 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:50.505357 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:50.505324 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:50.702954 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:50.702847 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:50.813567 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:50.813537 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:51.894970 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:51.894932 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:51.971895 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:51.971833 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:52.053890 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:52.053858 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:52.471726 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:52.471694 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:52.580893 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:52.580830 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:53.596886 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:53.596842 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:55.056254 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:55.056224 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:24:57.058281 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:57.058220 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:24:57.512515 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:24:57.512402 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:00.232563 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:00.232522 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:03.233644 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:03.233605 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:03.356557 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:03.356427 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:05.754509 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:05.754460 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:25:05.974263 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:05.974229 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:09.939947 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:09.939905 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:11.702478 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:11.702439 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:11.842035 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:11.842000 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:11.940314 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:11.940281 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:12.930691 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:12.930657 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:15.055377 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:15.055341 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:25:15.595591 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:15.595558 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:15.778386 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:15.778349 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:15.885667 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:15.885553 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:15.992699 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:15.992661 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:17.208823 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:17.208791 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:22.306134 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:22.306095 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:22.367362 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:22.367323 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:22.797111 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:22.797075 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:22.894055 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:22.894013 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:22.994848 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:22.994814 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:23.564571 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:23.564529 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:25:24.471524 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:24.471460 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:31.125390 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:31.125353 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:31.182703 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:31.182664 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:31.260989 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:31.260954 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:31.360985 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:31.360944 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:31.461426 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:31.461330 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:31.868650 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:31.868600 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:56.448402 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:56.448361 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:25:57.850933 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:25:57.850883 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:01.836651 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:01.836611 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:01.938236 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:01.938196 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:03.718707 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:03.718667 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:03.825292 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:03.825254 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:03.923169 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:03.923130 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:19.850625 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:19.850591 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:25.948635 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:25.948589 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:26.049553 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:26.049463 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:26.154899 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:26.154854 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:36.703546 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:36.703490 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:37.522622 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:37.522582 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:44.022540 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:44.022479 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:44.130887 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:44.130857 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:44.231564 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:44.231524 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:44.330841 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:44.330805 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:45.246030 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:45.245991 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:45.339919 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:45.339882 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:45.443923 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:45.443885 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:46.746561 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:46.746469 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:26:47.229052 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:47.229018 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:53.477911 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:53.477862 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:53.532129 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:53.532094 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:54.197275 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:54.197235 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:26:54.430620 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:26:54.430584 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:27:00.248634 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:00.248593 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:00.349107 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:00.349075 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:00.504436 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:00.504344 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:00.834204 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:00.834153 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:00.982487 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:00.982445 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:03.055193 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:03.055153 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:27:03.655246 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:03.655205 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:03.729626 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:03.729590 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:03.802560 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:03.802527 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:03.928032 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:03.927943 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:04.373825 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:04.373788 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:04.472831 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:04.472795 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:08.185621 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:08.185585 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:08.876078 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:08.876042 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:08.971345 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:08.971309 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:09.326012 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:09.325975 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:12.954787 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:12.954749 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:27:15.265644 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:15.265609 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:15.364152 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:15.364116 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:15.704453 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:15.704417 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:16.088224 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:16.088180 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:16.188708 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:16.188668 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:20.252115 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:20.252084 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:27:22.315973 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:22.315921 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:22.416343 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:22.416302 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:22.600600 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:22.600477 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:22.839462 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:22.839426 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:22.957640 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:22.957548 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:23.058377 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:23.058334 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:23.177753 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:23.177713 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:29.744706 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:29.744663 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:29.809366 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:29.809325 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:29.879710 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:29.879670 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:29.980463 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:29.980427 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:30.109150 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:30.109111 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:36.392777 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:36.392742 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:36.454649 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:36.454617 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:43.511326 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:43.511285 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:43.890842 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:43.890811 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:44.169062 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:44.168951 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:47.050420 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:47.050367 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:47.151075 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:47.151039 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:47.248082 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:47.248049 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:47.359195 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:47.359165 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:47.832171 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:47.832134 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:47.925207 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:47.925175 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:51.150962 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:51.150923 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:27:51.582109 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:51.582071 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:52.963465 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:52.963428 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:27:53.067118 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:27:53.067082 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:28:04.061522 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.061463 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk"] Jul 06 21:28:04.065034 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.065008 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.069988 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.069963 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-746edc43\"/\"openshift-service-ca.crt\"" Jul 06 21:28:04.070135 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.069963 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-746edc43\"/\"default-dockercfg-rkfkr\"" Jul 06 21:28:04.070829 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.070806 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-746edc43\"/\"kube-root-ca.crt\"" Jul 06 21:28:04.070965 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.070943 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-746edc43\"/\"e2e-lifecycle-model-746edc43-kserve-self-signed-certs\"" Jul 06 21:28:04.080947 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.080917 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk"] Jul 06 21:28:04.150578 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.150528 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:28:04.161551 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.161458 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-dshm\") pod \"e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.161775 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.161638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-model-cache\") pod \"e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.161775 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.161679 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/019eb71e-4ea0-4a24-9688-718406afdd12-tls-certs\") pod \"e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.161775 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.161710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnnwp\" (UniqueName: \"kubernetes.io/projected/019eb71e-4ea0-4a24-9688-718406afdd12-kube-api-access-qnnwp\") pod \"e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.161775 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.161764 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-home\") pod \"e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.161928 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.161779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-tmp-dir\") pod \"e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.262930 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.262877 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnnwp\" (UniqueName: \"kubernetes.io/projected/019eb71e-4ea0-4a24-9688-718406afdd12-kube-api-access-qnnwp\") pod \"e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.262930 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.262935 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-home\") pod \"e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.263144 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.263044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-tmp-dir\") pod \"e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.263144 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.263132 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-dshm\") pod \"e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.263230 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.263208 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-model-cache\") pod \"e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.263271 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.263258 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/019eb71e-4ea0-4a24-9688-718406afdd12-tls-certs\") pod \"e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.263358 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.263342 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-home\") pod \"e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.263429 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.263404 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-tmp-dir\") pod \"e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.263582 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.263555 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-model-cache\") pod \"e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.265608 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.265583 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-dshm\") pod \"e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.265802 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.265784 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/019eb71e-4ea0-4a24-9688-718406afdd12-tls-certs\") pod \"e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.274707 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.274675 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnnwp\" (UniqueName: \"kubernetes.io/projected/019eb71e-4ea0-4a24-9688-718406afdd12-kube-api-access-qnnwp\") pod \"e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.374741 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.374633 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:04.531972 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:04.531941 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk"] Jul 06 21:28:04.535030 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:28:04.535006 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod019eb71e_4ea0_4a24_9688_718406afdd12.slice/crio-8b1c0a1a1a4c1f47f6adfa473f45d93b3734e18ef571c97eccddf09aafdfc4e0 WatchSource:0}: Error finding container 8b1c0a1a1a4c1f47f6adfa473f45d93b3734e18ef571c97eccddf09aafdfc4e0: Status 404 returned error can't find the container with id 8b1c0a1a1a4c1f47f6adfa473f45d93b3734e18ef571c97eccddf09aafdfc4e0 Jul 06 21:28:05.066683 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:05.066645 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" event={"ID":"019eb71e-4ea0-4a24-9688-718406afdd12","Type":"ContainerStarted","Data":"bf22587dcf9cbbe9bc47bf02dbfd4bbd44993ebe38a41d101f0fa81a8815f904"} Jul 06 21:28:05.066683 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:05.066693 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" event={"ID":"019eb71e-4ea0-4a24-9688-718406afdd12","Type":"ContainerStarted","Data":"8b1c0a1a1a4c1f47f6adfa473f45d93b3734e18ef571c97eccddf09aafdfc4e0"} Jul 06 21:28:05.090477 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:05.090422 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" podStartSLOduration=1.090406688 podStartE2EDuration="1.090406688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:28:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:28:05.088718794 +0000 UTC m=+1780.617566593" watchObservedRunningTime="2026-07-06 21:28:05.090406688 +0000 UTC m=+1780.619254487" Jul 06 21:28:07.488992 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:07.488960 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:28:08.770590 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:08.770554 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:28:08.868489 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:08.868448 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:28:14.375398 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:14.375359 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:14.376032 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:14.375439 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:14.388434 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:14.388402 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:15.123604 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:15.123570 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:22.248932 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:22.248894 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:28:24.842154 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:24.842111 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:28:25.098223 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:25.098138 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:28:25.101719 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:25.101693 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 21:28:25.105699 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:25.105678 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:28:25.108788 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:25.108765 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 21:28:25.109185 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:25.109170 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 21:28:25.116411 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:25.116394 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 21:28:25.607056 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:25.607010 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:28:30.943431 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:30.943394 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:28:35.907128 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:35.907082 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk"] Jul 06 21:28:36.004014 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:36.003978 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:28:36.354124 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:36.354084 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:28:50.927667 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:50.927623 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" podUID="019eb71e-4ea0-4a24-9688-718406afdd12" containerName="main" containerID="cri-o://bf22587dcf9cbbe9bc47bf02dbfd4bbd44993ebe38a41d101f0fa81a8815f904" gracePeriod=45 Jul 06 21:28:51.170388 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.170366 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:51.274632 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.274549 2564 generic.go:356] "Generic (PLEG): container finished" podID="019eb71e-4ea0-4a24-9688-718406afdd12" containerID="bf22587dcf9cbbe9bc47bf02dbfd4bbd44993ebe38a41d101f0fa81a8815f904" exitCode=0 Jul 06 21:28:51.274632 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.274590 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" event={"ID":"019eb71e-4ea0-4a24-9688-718406afdd12","Type":"ContainerDied","Data":"bf22587dcf9cbbe9bc47bf02dbfd4bbd44993ebe38a41d101f0fa81a8815f904"} Jul 06 21:28:51.274632 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.274600 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" Jul 06 21:28:51.274842 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.274645 2564 scope.go:117] "RemoveContainer" containerID="bf22587dcf9cbbe9bc47bf02dbfd4bbd44993ebe38a41d101f0fa81a8815f904" Jul 06 21:28:51.274842 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.274635 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk" event={"ID":"019eb71e-4ea0-4a24-9688-718406afdd12","Type":"ContainerDied","Data":"8b1c0a1a1a4c1f47f6adfa473f45d93b3734e18ef571c97eccddf09aafdfc4e0"} Jul 06 21:28:51.283077 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.283062 2564 scope.go:117] "RemoveContainer" containerID="bf22587dcf9cbbe9bc47bf02dbfd4bbd44993ebe38a41d101f0fa81a8815f904" Jul 06 21:28:51.283311 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:28:51.283292 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf22587dcf9cbbe9bc47bf02dbfd4bbd44993ebe38a41d101f0fa81a8815f904\": container with ID starting with bf22587dcf9cbbe9bc47bf02dbfd4bbd44993ebe38a41d101f0fa81a8815f904 not found: ID does not exist" containerID="bf22587dcf9cbbe9bc47bf02dbfd4bbd44993ebe38a41d101f0fa81a8815f904" Jul 06 21:28:51.283360 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.283318 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf22587dcf9cbbe9bc47bf02dbfd4bbd44993ebe38a41d101f0fa81a8815f904"} err="failed to get container status \"bf22587dcf9cbbe9bc47bf02dbfd4bbd44993ebe38a41d101f0fa81a8815f904\": rpc error: code = NotFound desc = could not find container \"bf22587dcf9cbbe9bc47bf02dbfd4bbd44993ebe38a41d101f0fa81a8815f904\": container with ID starting with bf22587dcf9cbbe9bc47bf02dbfd4bbd44993ebe38a41d101f0fa81a8815f904 not found: ID does not exist" Jul 06 21:28:51.285582 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.285566 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/019eb71e-4ea0-4a24-9688-718406afdd12-tls-certs\") pod \"019eb71e-4ea0-4a24-9688-718406afdd12\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " Jul 06 21:28:51.285650 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.285600 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-home\") pod \"019eb71e-4ea0-4a24-9688-718406afdd12\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " Jul 06 21:28:51.285650 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.285614 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-tmp-dir\") pod \"019eb71e-4ea0-4a24-9688-718406afdd12\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " Jul 06 21:28:51.285753 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.285658 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-model-cache\") pod \"019eb71e-4ea0-4a24-9688-718406afdd12\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " Jul 06 21:28:51.285753 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.285731 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-dshm\") pod \"019eb71e-4ea0-4a24-9688-718406afdd12\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " Jul 06 21:28:51.285856 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.285772 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnnwp\" (UniqueName: \"kubernetes.io/projected/019eb71e-4ea0-4a24-9688-718406afdd12-kube-api-access-qnnwp\") pod \"019eb71e-4ea0-4a24-9688-718406afdd12\" (UID: \"019eb71e-4ea0-4a24-9688-718406afdd12\") " Jul 06 21:28:51.285910 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.285874 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-home" (OuterVolumeSpecName: "home") pod "019eb71e-4ea0-4a24-9688-718406afdd12" (UID: "019eb71e-4ea0-4a24-9688-718406afdd12"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:28:51.285963 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.285925 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "019eb71e-4ea0-4a24-9688-718406afdd12" (UID: "019eb71e-4ea0-4a24-9688-718406afdd12"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:28:51.285963 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.285944 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-model-cache" (OuterVolumeSpecName: "model-cache") pod "019eb71e-4ea0-4a24-9688-718406afdd12" (UID: "019eb71e-4ea0-4a24-9688-718406afdd12"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:28:51.286113 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.286093 2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-home\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:28:51.286176 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.286123 2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-tmp-dir\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:28:51.286176 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.286141 2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-model-cache\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:28:51.287806 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.287776 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/019eb71e-4ea0-4a24-9688-718406afdd12-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "019eb71e-4ea0-4a24-9688-718406afdd12" (UID: "019eb71e-4ea0-4a24-9688-718406afdd12"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:28:51.287944 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.287922 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/019eb71e-4ea0-4a24-9688-718406afdd12-kube-api-access-qnnwp" (OuterVolumeSpecName: "kube-api-access-qnnwp") pod "019eb71e-4ea0-4a24-9688-718406afdd12" (UID: "019eb71e-4ea0-4a24-9688-718406afdd12"). InnerVolumeSpecName "kube-api-access-qnnwp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:28:51.287944 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.287936 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-dshm" (OuterVolumeSpecName: "dshm") pod "019eb71e-4ea0-4a24-9688-718406afdd12" (UID: "019eb71e-4ea0-4a24-9688-718406afdd12"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:28:51.387257 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.387211 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnnwp\" (UniqueName: \"kubernetes.io/projected/019eb71e-4ea0-4a24-9688-718406afdd12-kube-api-access-qnnwp\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:28:51.387257 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.387255 2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/019eb71e-4ea0-4a24-9688-718406afdd12-tls-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:28:51.387257 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.387265 2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/019eb71e-4ea0-4a24-9688-718406afdd12-dshm\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:28:51.605996 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.605963 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk"] Jul 06 21:28:51.615511 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:51.615480 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-746edc43/e2e-lifecycle-model-746edc43-kserve-74485d9d95-99hwk"] Jul 06 21:28:53.028729 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:28:53.028698 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="019eb71e-4ea0-4a24-9688-718406afdd12" path="/var/lib/kubelet/pods/019eb71e-4ea0-4a24-9688-718406afdd12/volumes" Jul 06 21:29:13.233839 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:13.233807 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:13.615536 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:13.615489 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:16.052689 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:16.052652 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:29:19.817309 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:19.817274 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:35.233242 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:35.233208 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:35.333558 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:35.333526 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:35.529915 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:35.529880 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:35.782799 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:35.782714 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:36.919786 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:36.919744 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:37.018548 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:37.018492 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:37.120164 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:37.120130 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:37.988906 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:37.988865 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:38.088662 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:38.088627 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:38.150046 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:38.150007 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:39.546672 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:39.546643 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:29:39.700797 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:39.700751 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:45.659409 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:45.659366 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:45.710154 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:45.710125 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:46.382939 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:46.382903 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:51.046070 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:51.046032 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:29:52.566447 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:52.566412 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:52.669732 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:52.669698 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:29:52.768424 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:29:52.768391 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:01.828568 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:01.828523 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:01.952875 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:01.952844 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:03.338863 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:03.338830 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:03.724484 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:03.724380 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:24.826447 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:24.826402 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:30.713545 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:30.713490 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:30.813143 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:30.813100 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:31.156948 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:31.156915 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:31.549908 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:31.549872 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:31.757150 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:31.757111 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:34.987970 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:34.987936 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:35.081881 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:35.081844 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:35.158989 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:35.158954 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:35.610997 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:35.610963 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:35.712002 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:35.711968 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:36.228211 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:36.228173 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:39.661260 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:39.661226 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:40.034060 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:40.034028 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:40.397728 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:40.397626 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:40.510276 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:40.510237 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:41.250748 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:41.250714 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:30:44.074963 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:44.074926 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:44.153563 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:44.153522 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:44.212319 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:44.212284 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:44.478194 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:44.478096 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:44.738603 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:44.738474 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:44.841128 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:44.841094 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:46.117197 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:46.117161 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:48.802807 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:48.802768 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:50.142700 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:50.142659 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:30:56.396174 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:56.396143 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:30:56.496616 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:30:56.496576 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:31:04.165963 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.165930 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt"] Jul 06 21:31:04.166460 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.166425 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="019eb71e-4ea0-4a24-9688-718406afdd12" containerName="main" Jul 06 21:31:04.166460 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.166444 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="019eb71e-4ea0-4a24-9688-718406afdd12" containerName="main" Jul 06 21:31:04.166616 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.166569 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="019eb71e-4ea0-4a24-9688-718406afdd12" containerName="main" Jul 06 21:31:04.169574 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.169552 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.172250 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.172227 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-078357\"/\"openshift-service-ca.crt\"" Jul 06 21:31:04.173170 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.173151 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-078357\"/\"kube-root-ca.crt\"" Jul 06 21:31:04.173277 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.173153 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-078357\"/\"test-model-078357-kserve-self-signed-certs\"" Jul 06 21:31:04.173640 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.173613 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-078357\"/\"default-dockercfg-w4b6x\"" Jul 06 21:31:04.184031 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.184001 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt"] Jul 06 21:31:04.193633 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.193597 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:31:04.262150 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.262118 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-dshm\") pod \"test-model-078357-kserve-575cb56d9-crkqt\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.262321 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.262205 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-tls-certs\") pod \"test-model-078357-kserve-575cb56d9-crkqt\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.262321 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.262242 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-model-cache\") pod \"test-model-078357-kserve-575cb56d9-crkqt\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.262321 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.262265 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8jnv\" (UniqueName: \"kubernetes.io/projected/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-kube-api-access-z8jnv\") pod \"test-model-078357-kserve-575cb56d9-crkqt\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.262321 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.262292 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-tmp-dir\") pod \"test-model-078357-kserve-575cb56d9-crkqt\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.262455 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.262342 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-home\") pod \"test-model-078357-kserve-575cb56d9-crkqt\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.363032 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.362993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8jnv\" (UniqueName: \"kubernetes.io/projected/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-kube-api-access-z8jnv\") pod \"test-model-078357-kserve-575cb56d9-crkqt\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.363218 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.363041 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-tmp-dir\") pod \"test-model-078357-kserve-575cb56d9-crkqt\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.363218 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.363160 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-home\") pod \"test-model-078357-kserve-575cb56d9-crkqt\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.363332 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.363225 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-dshm\") pod \"test-model-078357-kserve-575cb56d9-crkqt\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.363332 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.363281 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-tls-certs\") pod \"test-model-078357-kserve-575cb56d9-crkqt\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.363332 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.363305 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-model-cache\") pod \"test-model-078357-kserve-575cb56d9-crkqt\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.363489 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.363463 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-tmp-dir\") pod \"test-model-078357-kserve-575cb56d9-crkqt\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.363619 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.363598 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-home\") pod \"test-model-078357-kserve-575cb56d9-crkqt\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.363672 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.363607 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-model-cache\") pod \"test-model-078357-kserve-575cb56d9-crkqt\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.365716 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.365697 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-dshm\") pod \"test-model-078357-kserve-575cb56d9-crkqt\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.366086 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.366066 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-tls-certs\") pod \"test-model-078357-kserve-575cb56d9-crkqt\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.379372 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.379344 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8jnv\" (UniqueName: \"kubernetes.io/projected/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-kube-api-access-z8jnv\") pod \"test-model-078357-kserve-575cb56d9-crkqt\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.481760 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.481674 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:04.618574 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.618548 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt"] Jul 06 21:31:04.621179 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:31:04.621154 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b2ddc3d_668b_4705_ad38_c8d2e9d4d49c.slice/crio-d585ef1d9c3521b54f590eb5df4b8d96f0ec27922dbf05405322f6429444c66c WatchSource:0}: Error finding container d585ef1d9c3521b54f590eb5df4b8d96f0ec27922dbf05405322f6429444c66c: Status 404 returned error can't find the container with id d585ef1d9c3521b54f590eb5df4b8d96f0ec27922dbf05405322f6429444c66c Jul 06 21:31:04.902035 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.901994 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" event={"ID":"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c","Type":"ContainerStarted","Data":"f6492c82c50909a92ed64b09f36650699f22f6b94baa7695719f246d70b04216"} Jul 06 21:31:04.902223 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.902046 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" event={"ID":"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c","Type":"ContainerStarted","Data":"d585ef1d9c3521b54f590eb5df4b8d96f0ec27922dbf05405322f6429444c66c"} Jul 06 21:31:04.921651 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:04.921586 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" podStartSLOduration=0.921569016 podStartE2EDuration="921.569016ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:31:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:31:04.920106104 +0000 UTC m=+1960.448953906" watchObservedRunningTime="2026-07-06 21:31:04.921569016 +0000 UTC m=+1960.450416815" Jul 06 21:31:06.532567 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:06.532531 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:31:06.632556 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:06.632492 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:31:08.545302 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:08.545263 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:31:14.482547 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:14.482487 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:14.482547 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:14.482556 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:14.495415 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:14.495388 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:14.960743 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:14.960715 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:31:37.550054 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.550009 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f"] Jul 06 21:31:37.553693 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.553671 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.556340 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.556316 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c3d033\"/\"kube-root-ca.crt\"" Jul 06 21:31:37.557158 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.557137 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c3d033\"/\"test-model-c3d033-kserve-self-signed-certs\"" Jul 06 21:31:37.557158 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.557149 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c3d033\"/\"default-dockercfg-hqjzz\"" Jul 06 21:31:37.557326 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.557188 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c3d033\"/\"openshift-service-ca.crt\"" Jul 06 21:31:37.563825 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.563802 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f"] Jul 06 21:31:37.566210 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.566186 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-tls-certs\") pod \"test-model-c3d033-kserve-58f55bd45-7h27f\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.566329 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.566256 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-tmp-dir\") pod \"test-model-c3d033-kserve-58f55bd45-7h27f\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.566329 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.566304 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rzfj\" (UniqueName: \"kubernetes.io/projected/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-kube-api-access-8rzfj\") pod \"test-model-c3d033-kserve-58f55bd45-7h27f\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.566445 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.566343 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-dshm\") pod \"test-model-c3d033-kserve-58f55bd45-7h27f\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.566445 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.566384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-home\") pod \"test-model-c3d033-kserve-58f55bd45-7h27f\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.566593 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.566465 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-model-cache\") pod \"test-model-c3d033-kserve-58f55bd45-7h27f\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.567576 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.567551 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:31:37.667102 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.667064 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-tmp-dir\") pod \"test-model-c3d033-kserve-58f55bd45-7h27f\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.667102 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.667111 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rzfj\" (UniqueName: \"kubernetes.io/projected/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-kube-api-access-8rzfj\") pod \"test-model-c3d033-kserve-58f55bd45-7h27f\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.667361 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.667133 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-dshm\") pod \"test-model-c3d033-kserve-58f55bd45-7h27f\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.667361 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.667157 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-home\") pod \"test-model-c3d033-kserve-58f55bd45-7h27f\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.667361 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.667201 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-model-cache\") pod \"test-model-c3d033-kserve-58f55bd45-7h27f\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.667361 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.667221 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-tls-certs\") pod \"test-model-c3d033-kserve-58f55bd45-7h27f\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.667607 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.667573 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-tmp-dir\") pod \"test-model-c3d033-kserve-58f55bd45-7h27f\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.667667 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.667632 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-home\") pod \"test-model-c3d033-kserve-58f55bd45-7h27f\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.667733 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.667713 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-model-cache\") pod \"test-model-c3d033-kserve-58f55bd45-7h27f\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.669630 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.669608 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-dshm\") pod \"test-model-c3d033-kserve-58f55bd45-7h27f\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.669887 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.669871 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-tls-certs\") pod \"test-model-c3d033-kserve-58f55bd45-7h27f\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.677680 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.677654 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rzfj\" (UniqueName: \"kubernetes.io/projected/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-kube-api-access-8rzfj\") pod \"test-model-c3d033-kserve-58f55bd45-7h27f\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:37.863537 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:37.863410 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:38.005055 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:38.005026 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f"] Jul 06 21:31:38.007570 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:31:38.007531 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod156b7224_3619_40a9_8fbc_6a5c1a8dcb69.slice/crio-0cfe61f13cf4b0d023c2e67e30bcd4038cd606fb06fe53849ffc08bedea53028 WatchSource:0}: Error finding container 0cfe61f13cf4b0d023c2e67e30bcd4038cd606fb06fe53849ffc08bedea53028: Status 404 returned error can't find the container with id 0cfe61f13cf4b0d023c2e67e30bcd4038cd606fb06fe53849ffc08bedea53028 Jul 06 21:31:38.055563 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:38.055529 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" event={"ID":"156b7224-3619-40a9-8fbc-6a5c1a8dcb69","Type":"ContainerStarted","Data":"0cfe61f13cf4b0d023c2e67e30bcd4038cd606fb06fe53849ffc08bedea53028"} Jul 06 21:31:39.061573 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:39.061536 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" event={"ID":"156b7224-3619-40a9-8fbc-6a5c1a8dcb69","Type":"ContainerStarted","Data":"e7bc7ae75fe1b77951d97106dfacf25626e8464608056101cd2ffe44b2453af9"} Jul 06 21:31:39.084705 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:39.084652 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" podStartSLOduration=2.084635968 podStartE2EDuration="2.084635968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:31:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:31:39.082896219 +0000 UTC m=+1994.611744018" watchObservedRunningTime="2026-07-06 21:31:39.084635968 +0000 UTC m=+1994.613483793" Jul 06 21:31:41.654860 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:41.654822 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:31:43.239902 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:43.239864 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:31:47.864515 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:47.864462 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:47.864961 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:47.864539 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:47.882613 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:47.882579 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:48.115687 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:48.115600 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:31:55.454107 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:55.454066 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:31:58.019191 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:58.019155 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt"] Jul 06 21:31:58.038262 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:58.038222 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:31:58.975743 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:58.975703 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f"] Jul 06 21:31:59.001765 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:59.001735 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:31:59.189587 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:59.189545 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:31:59.609829 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:59.609791 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:31:59.709997 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:59.709965 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:31:59.810015 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:59.809980 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:31:59.880693 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:31:59.880612 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:04.690832 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:04.690791 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:10.753367 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:10.753333 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:32:13.040671 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.040629 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" podUID="0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c" containerName="main" containerID="cri-o://f6492c82c50909a92ed64b09f36650699f22f6b94baa7695719f246d70b04216" gracePeriod=45 Jul 06 21:32:13.229940 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.229909 2564 generic.go:356] "Generic (PLEG): container finished" podID="0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c" containerID="f6492c82c50909a92ed64b09f36650699f22f6b94baa7695719f246d70b04216" exitCode=0 Jul 06 21:32:13.230108 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.229957 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" event={"ID":"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c","Type":"ContainerDied","Data":"f6492c82c50909a92ed64b09f36650699f22f6b94baa7695719f246d70b04216"} Jul 06 21:32:13.292911 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.292843 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:32:13.391615 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.391576 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-home\") pod \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " Jul 06 21:32:13.391809 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.391654 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-tls-certs\") pod \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " Jul 06 21:32:13.391809 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.391692 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-model-cache\") pod \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " Jul 06 21:32:13.391809 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.391727 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-tmp-dir\") pod \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " Jul 06 21:32:13.391978 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.391846 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-home" (OuterVolumeSpecName: "home") pod "0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c" (UID: "0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:32:13.391978 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.391908 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8jnv\" (UniqueName: \"kubernetes.io/projected/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-kube-api-access-z8jnv\") pod \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " Jul 06 21:32:13.391978 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.391958 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-dshm\") pod \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\" (UID: \"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c\") " Jul 06 21:32:13.391978 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.391967 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c" (UID: "0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:32:13.392141 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.391984 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-model-cache" (OuterVolumeSpecName: "model-cache") pod "0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c" (UID: "0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:32:13.392285 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.392258 2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-tmp-dir\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:32:13.392359 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.392291 2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-home\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:32:13.392359 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.392308 2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-model-cache\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:32:13.394064 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.394038 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-dshm" (OuterVolumeSpecName: "dshm") pod "0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c" (UID: "0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:32:13.394170 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.394088 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c" (UID: "0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:32:13.394214 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.394182 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-kube-api-access-z8jnv" (OuterVolumeSpecName: "kube-api-access-z8jnv") pod "0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c" (UID: "0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c"). InnerVolumeSpecName "kube-api-access-z8jnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:32:13.493722 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.493685 2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-tls-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:32:13.493722 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.493714 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8jnv\" (UniqueName: \"kubernetes.io/projected/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-kube-api-access-z8jnv\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:32:13.493722 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.493729 2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c-dshm\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:32:13.996712 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:13.996672 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" podUID="156b7224-3619-40a9-8fbc-6a5c1a8dcb69" containerName="main" containerID="cri-o://e7bc7ae75fe1b77951d97106dfacf25626e8464608056101cd2ffe44b2453af9" gracePeriod=45 Jul 06 21:32:14.237006 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.236976 2564 generic.go:356] "Generic (PLEG): container finished" podID="156b7224-3619-40a9-8fbc-6a5c1a8dcb69" containerID="e7bc7ae75fe1b77951d97106dfacf25626e8464608056101cd2ffe44b2453af9" exitCode=0 Jul 06 21:32:14.237395 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.237044 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" event={"ID":"156b7224-3619-40a9-8fbc-6a5c1a8dcb69","Type":"ContainerDied","Data":"e7bc7ae75fe1b77951d97106dfacf25626e8464608056101cd2ffe44b2453af9"} Jul 06 21:32:14.238339 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.238319 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" event={"ID":"0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c","Type":"ContainerDied","Data":"d585ef1d9c3521b54f590eb5df4b8d96f0ec27922dbf05405322f6429444c66c"} Jul 06 21:32:14.238457 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.238358 2564 scope.go:117] "RemoveContainer" containerID="f6492c82c50909a92ed64b09f36650699f22f6b94baa7695719f246d70b04216" Jul 06 21:32:14.238457 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.238374 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt" Jul 06 21:32:14.262598 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.262574 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:32:14.273335 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.273303 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt"] Jul 06 21:32:14.277870 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.277843 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-078357/test-model-078357-kserve-575cb56d9-crkqt"] Jul 06 21:32:14.400891 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.400857 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-dshm\") pod \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " Jul 06 21:32:14.400891 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.400887 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-home\") pod \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " Jul 06 21:32:14.401147 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.400936 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-tls-certs\") pod \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " Jul 06 21:32:14.401147 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.400958 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-model-cache\") pod \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " Jul 06 21:32:14.401147 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.401018 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-tmp-dir\") pod \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " Jul 06 21:32:14.401147 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.401046 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rzfj\" (UniqueName: \"kubernetes.io/projected/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-kube-api-access-8rzfj\") pod \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\" (UID: \"156b7224-3619-40a9-8fbc-6a5c1a8dcb69\") " Jul 06 21:32:14.401340 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.401144 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-home" (OuterVolumeSpecName: "home") pod "156b7224-3619-40a9-8fbc-6a5c1a8dcb69" (UID: "156b7224-3619-40a9-8fbc-6a5c1a8dcb69"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:32:14.401340 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.401255 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "156b7224-3619-40a9-8fbc-6a5c1a8dcb69" (UID: "156b7224-3619-40a9-8fbc-6a5c1a8dcb69"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:32:14.401340 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.401267 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-model-cache" (OuterVolumeSpecName: "model-cache") pod "156b7224-3619-40a9-8fbc-6a5c1a8dcb69" (UID: "156b7224-3619-40a9-8fbc-6a5c1a8dcb69"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:32:14.401480 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.401353 2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-tmp-dir\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:32:14.401480 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.401365 2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-home\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:32:14.401480 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.401374 2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-model-cache\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:32:14.403255 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.403228 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "156b7224-3619-40a9-8fbc-6a5c1a8dcb69" (UID: "156b7224-3619-40a9-8fbc-6a5c1a8dcb69"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:32:14.403255 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.403244 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-dshm" (OuterVolumeSpecName: "dshm") pod "156b7224-3619-40a9-8fbc-6a5c1a8dcb69" (UID: "156b7224-3619-40a9-8fbc-6a5c1a8dcb69"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:32:14.403392 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.403256 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-kube-api-access-8rzfj" (OuterVolumeSpecName: "kube-api-access-8rzfj") pod "156b7224-3619-40a9-8fbc-6a5c1a8dcb69" (UID: "156b7224-3619-40a9-8fbc-6a5c1a8dcb69"). InnerVolumeSpecName "kube-api-access-8rzfj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:32:14.502208 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.502171 2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-dshm\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:32:14.502208 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.502217 2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-tls-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:32:14.502385 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:14.502227 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rzfj\" (UniqueName: \"kubernetes.io/projected/156b7224-3619-40a9-8fbc-6a5c1a8dcb69-kube-api-access-8rzfj\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:32:15.028264 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:15.028233 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c" path="/var/lib/kubelet/pods/0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c/volumes" Jul 06 21:32:15.244520 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:15.244479 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" Jul 06 21:32:15.244927 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:15.244483 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f" event={"ID":"156b7224-3619-40a9-8fbc-6a5c1a8dcb69","Type":"ContainerDied","Data":"0cfe61f13cf4b0d023c2e67e30bcd4038cd606fb06fe53849ffc08bedea53028"} Jul 06 21:32:15.244927 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:15.244623 2564 scope.go:117] "RemoveContainer" containerID="e7bc7ae75fe1b77951d97106dfacf25626e8464608056101cd2ffe44b2453af9" Jul 06 21:32:15.262598 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:15.262575 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f"] Jul 06 21:32:15.266683 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:15.266660 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-c3d033/test-model-c3d033-kserve-58f55bd45-7h27f"] Jul 06 21:32:17.028601 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:17.028566 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="156b7224-3619-40a9-8fbc-6a5c1a8dcb69" path="/var/lib/kubelet/pods/156b7224-3619-40a9-8fbc-6a5c1a8dcb69/volumes" Jul 06 21:32:42.097283 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:42.097250 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:42.347435 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:42.347341 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:42.647714 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:42.647614 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:42.869458 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:42.869420 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:43.284296 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:43.284219 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:43.381309 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:43.381266 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:43.481242 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:43.481206 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:43.577202 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:43.577112 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:44.416108 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:44.416075 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:46.465756 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:46.465670 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:32:49.278560 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:49.278519 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:49.379287 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:49.379248 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:49.536806 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:49.536706 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:49.785466 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:49.785427 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:50.157290 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:50.157251 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:50.508420 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:50.508323 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:50.696237 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:50.696194 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:53.608332 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:53.608288 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:53.686268 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:53.686230 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:53.745197 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:53.745157 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:53.849242 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:53.849201 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:54.066365 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:54.066323 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:54.135619 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:54.135581 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:54.604732 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:54.604697 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:54.702341 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:54.702305 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:58.168709 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:58.168674 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:58.656073 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:58.656035 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:58.982609 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:58.982522 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:59.245248 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:59.245152 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:32:59.587199 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:32:59.587164 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:00.752309 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:00.752274 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:33:01.693040 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:01.693001 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:01.843818 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:01.843771 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:01.933012 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:01.932965 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:02.075992 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:02.075951 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:02.400786 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:02.400687 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:02.507006 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:02.506969 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:06.198108 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:06.198072 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:14.392985 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:14.392943 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:14.746422 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:14.746321 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:14.864617 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:14.864581 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:14.965524 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:14.965469 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:15.252731 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:15.252696 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:15.890649 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:15.890613 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:16.243714 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:16.243631 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:33:21.046633 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:21.046594 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:21.146373 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:21.146334 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:21.310300 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:21.310208 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:21.535324 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:21.535290 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:21.774888 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:21.774790 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:22.147343 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:22.147301 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:22.247246 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:22.247206 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:22.349238 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:22.349203 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:22.518892 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:22.518756 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:25.124842 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:25.124812 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:33:25.128391 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:25.128365 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 21:33:25.134634 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:25.134614 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:33:25.135824 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:25.135806 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 21:33:25.137845 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:25.137827 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 21:33:25.144592 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:25.144576 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 21:33:25.650095 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:25.650052 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:33:28.285392 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:28.285354 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:28.385744 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:28.385704 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:28.582281 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:28.582186 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:28.799785 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:28.799753 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:29.130126 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:29.130087 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:29.446720 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:29.446604 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:29.659188 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:29.659149 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:32.864835 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:32.864796 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:32.960780 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:32.960740 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:33.112298 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:33.112255 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:33.548432 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:33.548389 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:33.648741 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:33.648706 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:36.936374 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:36.936333 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:33:37.382661 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:37.382625 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:37.706944 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:37.706848 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:38.037549 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:38.037513 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:38.830779 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:38.830743 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:40.904884 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:40.904853 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:41.000096 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:41.000060 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:41.097782 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:41.097742 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:41.557911 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:41.557875 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:41.658032 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:41.657988 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:41.761830 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:41.761789 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:45.428955 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:45.428916 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:48.237785 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.237747 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl"] Jul 06 21:33:48.238152 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.238096 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="156b7224-3619-40a9-8fbc-6a5c1a8dcb69" containerName="main" Jul 06 21:33:48.238152 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.238108 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="156b7224-3619-40a9-8fbc-6a5c1a8dcb69" containerName="main" Jul 06 21:33:48.238152 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.238137 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c" containerName="main" Jul 06 21:33:48.238152 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.238146 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c" containerName="main" Jul 06 21:33:48.238282 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.238204 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b2ddc3d-668b-4705-ad38-c8d2e9d4d49c" containerName="main" Jul 06 21:33:48.238282 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.238214 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="156b7224-3619-40a9-8fbc-6a5c1a8dcb69" containerName="main" Jul 06 21:33:48.241315 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.241295 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.244612 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.244589 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-900ebe\"/\"openshift-service-ca.crt\"" Jul 06 21:33:48.244612 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.244598 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-900ebe\"/\"auth-test-model-900ebe-kserve-self-signed-certs\"" Jul 06 21:33:48.244813 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.244616 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-900ebe\"/\"kube-root-ca.crt\"" Jul 06 21:33:48.244813 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.244610 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-900ebe\"/\"default-dockercfg-b545d\"" Jul 06 21:33:48.250424 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.250400 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl"] Jul 06 21:33:48.260121 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.260089 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:48.317618 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.317585 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-home\") pod \"auth-test-model-900ebe-kserve-7dd97954f5-jrrxl\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.317618 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.317632 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-model-cache\") pod \"auth-test-model-900ebe-kserve-7dd97954f5-jrrxl\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.317846 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.317681 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn67t\" (UniqueName: \"kubernetes.io/projected/1f5b65f4-be54-4960-a5b0-40881cc1597b-kube-api-access-jn67t\") pod \"auth-test-model-900ebe-kserve-7dd97954f5-jrrxl\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.317846 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.317705 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-dshm\") pod \"auth-test-model-900ebe-kserve-7dd97954f5-jrrxl\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.317846 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.317759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-tmp-dir\") pod \"auth-test-model-900ebe-kserve-7dd97954f5-jrrxl\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.317846 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.317781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f5b65f4-be54-4960-a5b0-40881cc1597b-tls-certs\") pod \"auth-test-model-900ebe-kserve-7dd97954f5-jrrxl\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.418761 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.418721 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-model-cache\") pod \"auth-test-model-900ebe-kserve-7dd97954f5-jrrxl\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.418761 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.418767 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn67t\" (UniqueName: \"kubernetes.io/projected/1f5b65f4-be54-4960-a5b0-40881cc1597b-kube-api-access-jn67t\") pod \"auth-test-model-900ebe-kserve-7dd97954f5-jrrxl\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.419042 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.418899 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-dshm\") pod \"auth-test-model-900ebe-kserve-7dd97954f5-jrrxl\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.419042 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.418995 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-tmp-dir\") pod \"auth-test-model-900ebe-kserve-7dd97954f5-jrrxl\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.419042 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.419034 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f5b65f4-be54-4960-a5b0-40881cc1597b-tls-certs\") pod \"auth-test-model-900ebe-kserve-7dd97954f5-jrrxl\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.419193 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.419097 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-home\") pod \"auth-test-model-900ebe-kserve-7dd97954f5-jrrxl\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.419251 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.419187 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-model-cache\") pod \"auth-test-model-900ebe-kserve-7dd97954f5-jrrxl\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.419373 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.419353 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-tmp-dir\") pod \"auth-test-model-900ebe-kserve-7dd97954f5-jrrxl\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.419463 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.419443 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-home\") pod \"auth-test-model-900ebe-kserve-7dd97954f5-jrrxl\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.421314 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.421296 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-dshm\") pod \"auth-test-model-900ebe-kserve-7dd97954f5-jrrxl\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.421574 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.421556 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f5b65f4-be54-4960-a5b0-40881cc1597b-tls-certs\") pod \"auth-test-model-900ebe-kserve-7dd97954f5-jrrxl\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.428713 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.428686 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn67t\" (UniqueName: \"kubernetes.io/projected/1f5b65f4-be54-4960-a5b0-40881cc1597b-kube-api-access-jn67t\") pod \"auth-test-model-900ebe-kserve-7dd97954f5-jrrxl\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.551241 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.551200 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:48.689036 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:48.689008 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl"] Jul 06 21:33:48.691763 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:33:48.691735 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f5b65f4_be54_4960_a5b0_40881cc1597b.slice/crio-51fdb6db4db4e1d740a81df29d4a520f1ca9e28eeaee3d086c99dd6e773f7689 WatchSource:0}: Error finding container 51fdb6db4db4e1d740a81df29d4a520f1ca9e28eeaee3d086c99dd6e773f7689: Status 404 returned error can't find the container with id 51fdb6db4db4e1d740a81df29d4a520f1ca9e28eeaee3d086c99dd6e773f7689 Jul 06 21:33:49.250693 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:49.250656 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:33:49.687687 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:49.687650 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" event={"ID":"1f5b65f4-be54-4960-a5b0-40881cc1597b","Type":"ContainerStarted","Data":"c8c61a90e5d8a6ee47c27d3d41eacd87168c1cc3cb67a8a53c5f4f27b6f648df"} Jul 06 21:33:49.687891 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:49.687699 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" event={"ID":"1f5b65f4-be54-4960-a5b0-40881cc1597b","Type":"ContainerStarted","Data":"51fdb6db4db4e1d740a81df29d4a520f1ca9e28eeaee3d086c99dd6e773f7689"} Jul 06 21:33:49.709457 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:49.709405 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" podStartSLOduration=1.70938737 podStartE2EDuration="1.70938737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:33:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:33:49.708289916 +0000 UTC m=+2125.237137714" watchObservedRunningTime="2026-07-06 21:33:49.70938737 +0000 UTC m=+2125.238235168" Jul 06 21:33:54.278463 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:54.278426 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:54.379048 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:54.379010 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:33:58.552186 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:58.552141 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:58.552726 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:58.552204 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:58.564878 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:58.564843 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:58.747562 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:58.747531 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:33:59.067651 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:33:59.067614 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:34:02.408079 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:02.408048 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:34:02.510547 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:02.510478 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:34:20.259406 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.259368 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh"] Jul 06 21:34:20.262702 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.262684 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.265237 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.265214 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5ea078\"/\"openshift-service-ca.crt\"" Jul 06 21:34:20.265365 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.265281 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5ea078\"/\"kube-root-ca.crt\"" Jul 06 21:34:20.266014 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.265999 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5ea078\"/\"default-dockercfg-vdnqp\"" Jul 06 21:34:20.266161 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.266142 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5ea078\"/\"auth-test-model-5ea078-kserve-self-signed-certs\"" Jul 06 21:34:20.271086 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.270999 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh"] Jul 06 21:34:20.296654 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.296613 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-dshm\") pod \"auth-test-model-5ea078-kserve-56f867c67-bfngh\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.296841 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.296690 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee45a61c-34a0-4576-8965-de98dd19d0b6-tls-certs\") pod \"auth-test-model-5ea078-kserve-56f867c67-bfngh\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.296841 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.296722 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-tmp-dir\") pod \"auth-test-model-5ea078-kserve-56f867c67-bfngh\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.296841 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.296738 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-home\") pod \"auth-test-model-5ea078-kserve-56f867c67-bfngh\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.296841 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.296777 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-model-cache\") pod \"auth-test-model-5ea078-kserve-56f867c67-bfngh\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.296841 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.296820 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6djd\" (UniqueName: \"kubernetes.io/projected/ee45a61c-34a0-4576-8965-de98dd19d0b6-kube-api-access-m6djd\") pod \"auth-test-model-5ea078-kserve-56f867c67-bfngh\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.300473 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.300426 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:34:20.397687 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.397649 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee45a61c-34a0-4576-8965-de98dd19d0b6-tls-certs\") pod \"auth-test-model-5ea078-kserve-56f867c67-bfngh\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.397897 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.397700 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-tmp-dir\") pod \"auth-test-model-5ea078-kserve-56f867c67-bfngh\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.397897 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.397729 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-home\") pod \"auth-test-model-5ea078-kserve-56f867c67-bfngh\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.397897 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.397755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-model-cache\") pod \"auth-test-model-5ea078-kserve-56f867c67-bfngh\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.397897 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.397784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6djd\" (UniqueName: \"kubernetes.io/projected/ee45a61c-34a0-4576-8965-de98dd19d0b6-kube-api-access-m6djd\") pod \"auth-test-model-5ea078-kserve-56f867c67-bfngh\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.397897 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.397855 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-dshm\") pod \"auth-test-model-5ea078-kserve-56f867c67-bfngh\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.398151 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.398124 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-tmp-dir\") pod \"auth-test-model-5ea078-kserve-56f867c67-bfngh\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.398193 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.398171 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-home\") pod \"auth-test-model-5ea078-kserve-56f867c67-bfngh\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.398263 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.398242 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-model-cache\") pod \"auth-test-model-5ea078-kserve-56f867c67-bfngh\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.400244 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.400223 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-dshm\") pod \"auth-test-model-5ea078-kserve-56f867c67-bfngh\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.400573 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.400548 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee45a61c-34a0-4576-8965-de98dd19d0b6-tls-certs\") pod \"auth-test-model-5ea078-kserve-56f867c67-bfngh\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.407818 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.407794 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6djd\" (UniqueName: \"kubernetes.io/projected/ee45a61c-34a0-4576-8965-de98dd19d0b6-kube-api-access-m6djd\") pod \"auth-test-model-5ea078-kserve-56f867c67-bfngh\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.573293 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.573267 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:20.720124 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.720087 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh"] Jul 06 21:34:20.724456 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:34:20.724426 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee45a61c_34a0_4576_8965_de98dd19d0b6.slice/crio-f2d1a216a49fc95dc043f2e045b9d6f162acf9f8aac5296c83951ca35a26b285 WatchSource:0}: Error finding container f2d1a216a49fc95dc043f2e045b9d6f162acf9f8aac5296c83951ca35a26b285: Status 404 returned error can't find the container with id f2d1a216a49fc95dc043f2e045b9d6f162acf9f8aac5296c83951ca35a26b285 Jul 06 21:34:20.838454 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.838359 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" event={"ID":"ee45a61c-34a0-4576-8965-de98dd19d0b6","Type":"ContainerStarted","Data":"19ca745108781ef05569957eab0ac23bb910fe680da40e86920d9d00042a2153"} Jul 06 21:34:20.838629 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.838401 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" event={"ID":"ee45a61c-34a0-4576-8965-de98dd19d0b6","Type":"ContainerStarted","Data":"f2d1a216a49fc95dc043f2e045b9d6f162acf9f8aac5296c83951ca35a26b285"} Jul 06 21:34:20.865803 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:20.865746 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" podStartSLOduration=0.865730722 podStartE2EDuration="865.730722ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:34:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:34:20.864592392 +0000 UTC m=+2156.393440191" watchObservedRunningTime="2026-07-06 21:34:20.865730722 +0000 UTC m=+2156.394578521" Jul 06 21:34:24.043209 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:24.043172 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:34:30.573654 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:30.573608 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:30.574102 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:30.573670 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:30.586368 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:30.586342 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:30.896481 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:30.896392 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:34:37.644780 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:37.644744 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:34:52.544088 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:34:52.544044 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:35:05.253739 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:35:05.253701 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:35:22.748056 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:35:22.748013 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:35:39.646806 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:35:39.646770 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:35:57.441792 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:35:57.441717 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:36:13.010361 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:13.010326 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:36:15.049828 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:15.049793 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:36:19.124860 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:19.124827 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl"] Jul 06 21:36:19.141982 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:19.141951 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:36:19.171454 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:36:19.171417 2564 secret.go:189] Couldn't get secret ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-self-signed-certs: secret "auth-test-model-900ebe-kserve-self-signed-certs" not found Jul 06 21:36:19.171643 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:36:19.171543 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f5b65f4-be54-4960-a5b0-40881cc1597b-tls-certs podName:1f5b65f4-be54-4960-a5b0-40881cc1597b nodeName:}" failed. No retries permitted until 2026-07-06 21:36:19.671492407 +0000 UTC m=+2275.200340188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1f5b65f4-be54-4960-a5b0-40881cc1597b-tls-certs") pod "auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" (UID: "1f5b65f4-be54-4960-a5b0-40881cc1597b") : secret "auth-test-model-900ebe-kserve-self-signed-certs" not found Jul 06 21:36:19.676543 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:36:19.676490 2564 secret.go:189] Couldn't get secret ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-self-signed-certs: secret "auth-test-model-900ebe-kserve-self-signed-certs" not found Jul 06 21:36:19.676727 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:36:19.676583 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f5b65f4-be54-4960-a5b0-40881cc1597b-tls-certs podName:1f5b65f4-be54-4960-a5b0-40881cc1597b nodeName:}" failed. No retries permitted until 2026-07-06 21:36:20.67656908 +0000 UTC m=+2276.205416857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1f5b65f4-be54-4960-a5b0-40881cc1597b-tls-certs") pod "auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" (UID: "1f5b65f4-be54-4960-a5b0-40881cc1597b") : secret "auth-test-model-900ebe-kserve-self-signed-certs" not found Jul 06 21:36:20.135005 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:20.134973 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh"] Jul 06 21:36:20.154609 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:20.154575 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:36:20.687058 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:36:20.687024 2564 secret.go:189] Couldn't get secret ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-self-signed-certs: secret "auth-test-model-900ebe-kserve-self-signed-certs" not found Jul 06 21:36:20.687248 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:36:20.687117 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f5b65f4-be54-4960-a5b0-40881cc1597b-tls-certs podName:1f5b65f4-be54-4960-a5b0-40881cc1597b nodeName:}" failed. No retries permitted until 2026-07-06 21:36:22.687101392 +0000 UTC m=+2278.215949169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1f5b65f4-be54-4960-a5b0-40881cc1597b-tls-certs") pod "auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" (UID: "1f5b65f4-be54-4960-a5b0-40881cc1597b") : secret "auth-test-model-900ebe-kserve-self-signed-certs" not found Jul 06 21:36:22.703560 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:36:22.703525 2564 secret.go:189] Couldn't get secret ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-self-signed-certs: secret "auth-test-model-900ebe-kserve-self-signed-certs" not found Jul 06 21:36:22.703943 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:36:22.703592 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f5b65f4-be54-4960-a5b0-40881cc1597b-tls-certs podName:1f5b65f4-be54-4960-a5b0-40881cc1597b nodeName:}" failed. No retries permitted until 2026-07-06 21:36:26.703578053 +0000 UTC m=+2282.232425830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1f5b65f4-be54-4960-a5b0-40881cc1597b-tls-certs") pod "auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" (UID: "1f5b65f4-be54-4960-a5b0-40881cc1597b") : secret "auth-test-model-900ebe-kserve-self-signed-certs" not found Jul 06 21:36:26.740534 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:36:26.740479 2564 secret.go:189] Couldn't get secret ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-self-signed-certs: secret "auth-test-model-900ebe-kserve-self-signed-certs" not found Jul 06 21:36:26.740925 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:36:26.740603 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f5b65f4-be54-4960-a5b0-40881cc1597b-tls-certs podName:1f5b65f4-be54-4960-a5b0-40881cc1597b nodeName:}" failed. No retries permitted until 2026-07-06 21:36:34.740582828 +0000 UTC m=+2290.269430605 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1f5b65f4-be54-4960-a5b0-40881cc1597b-tls-certs") pod "auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" (UID: "1f5b65f4-be54-4960-a5b0-40881cc1597b") : secret "auth-test-model-900ebe-kserve-self-signed-certs" not found Jul 06 21:36:31.445013 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:31.444975 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:36:31.767701 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:31.767607 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:36:34.416886 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.416847 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" podUID="1f5b65f4-be54-4960-a5b0-40881cc1597b" containerName="main" containerID="cri-o://c8c61a90e5d8a6ee47c27d3d41eacd87168c1cc3cb67a8a53c5f4f27b6f648df" gracePeriod=45 Jul 06 21:36:34.666971 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.666893 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:36:34.715820 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.715784 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f5b65f4-be54-4960-a5b0-40881cc1597b-tls-certs\") pod \"1f5b65f4-be54-4960-a5b0-40881cc1597b\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " Jul 06 21:36:34.716021 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.715836 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-home\") pod \"1f5b65f4-be54-4960-a5b0-40881cc1597b\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " Jul 06 21:36:34.716021 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.715857 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-model-cache\") pod \"1f5b65f4-be54-4960-a5b0-40881cc1597b\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " Jul 06 21:36:34.716021 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.715879 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-tmp-dir\") pod \"1f5b65f4-be54-4960-a5b0-40881cc1597b\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " Jul 06 21:36:34.716021 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.715924 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jn67t\" (UniqueName: \"kubernetes.io/projected/1f5b65f4-be54-4960-a5b0-40881cc1597b-kube-api-access-jn67t\") pod \"1f5b65f4-be54-4960-a5b0-40881cc1597b\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " Jul 06 21:36:34.716021 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.715998 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-dshm\") pod \"1f5b65f4-be54-4960-a5b0-40881cc1597b\" (UID: \"1f5b65f4-be54-4960-a5b0-40881cc1597b\") " Jul 06 21:36:34.716284 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.716156 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-home" (OuterVolumeSpecName: "home") pod "1f5b65f4-be54-4960-a5b0-40881cc1597b" (UID: "1f5b65f4-be54-4960-a5b0-40881cc1597b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:36:34.716284 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.716168 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-model-cache" (OuterVolumeSpecName: "model-cache") pod "1f5b65f4-be54-4960-a5b0-40881cc1597b" (UID: "1f5b65f4-be54-4960-a5b0-40881cc1597b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:36:34.716284 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.716191 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1f5b65f4-be54-4960-a5b0-40881cc1597b" (UID: "1f5b65f4-be54-4960-a5b0-40881cc1597b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:36:34.716445 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.716331 2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-home\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:36:34.716445 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.716348 2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-model-cache\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:36:34.716445 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.716366 2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-tmp-dir\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:36:34.718341 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.718308 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-dshm" (OuterVolumeSpecName: "dshm") pod "1f5b65f4-be54-4960-a5b0-40881cc1597b" (UID: "1f5b65f4-be54-4960-a5b0-40881cc1597b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:36:34.718341 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.718311 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f5b65f4-be54-4960-a5b0-40881cc1597b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1f5b65f4-be54-4960-a5b0-40881cc1597b" (UID: "1f5b65f4-be54-4960-a5b0-40881cc1597b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:36:34.718544 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.718339 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f5b65f4-be54-4960-a5b0-40881cc1597b-kube-api-access-jn67t" (OuterVolumeSpecName: "kube-api-access-jn67t") pod "1f5b65f4-be54-4960-a5b0-40881cc1597b" (UID: "1f5b65f4-be54-4960-a5b0-40881cc1597b"). InnerVolumeSpecName "kube-api-access-jn67t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:36:34.817634 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.817586 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn67t\" (UniqueName: \"kubernetes.io/projected/1f5b65f4-be54-4960-a5b0-40881cc1597b-kube-api-access-jn67t\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:36:34.817634 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.817628 2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f5b65f4-be54-4960-a5b0-40881cc1597b-dshm\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:36:34.817634 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:34.817637 2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f5b65f4-be54-4960-a5b0-40881cc1597b-tls-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:36:35.156365 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.156296 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" podUID="ee45a61c-34a0-4576-8965-de98dd19d0b6" containerName="main" containerID="cri-o://19ca745108781ef05569957eab0ac23bb910fe680da40e86920d9d00042a2153" gracePeriod=45 Jul 06 21:36:35.396130 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.396099 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:36:35.424337 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.424300 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-tmp-dir\") pod \"ee45a61c-34a0-4576-8965-de98dd19d0b6\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " Jul 06 21:36:35.424767 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.424429 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-dshm\") pod \"ee45a61c-34a0-4576-8965-de98dd19d0b6\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " Jul 06 21:36:35.424767 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.424468 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-home\") pod \"ee45a61c-34a0-4576-8965-de98dd19d0b6\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " Jul 06 21:36:35.424767 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.424633 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ee45a61c-34a0-4576-8965-de98dd19d0b6" (UID: "ee45a61c-34a0-4576-8965-de98dd19d0b6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:36:35.424767 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.424642 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6djd\" (UniqueName: \"kubernetes.io/projected/ee45a61c-34a0-4576-8965-de98dd19d0b6-kube-api-access-m6djd\") pod \"ee45a61c-34a0-4576-8965-de98dd19d0b6\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " Jul 06 21:36:35.424767 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.424745 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee45a61c-34a0-4576-8965-de98dd19d0b6-tls-certs\") pod \"ee45a61c-34a0-4576-8965-de98dd19d0b6\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " Jul 06 21:36:35.425023 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.424804 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-model-cache\") pod \"ee45a61c-34a0-4576-8965-de98dd19d0b6\" (UID: \"ee45a61c-34a0-4576-8965-de98dd19d0b6\") " Jul 06 21:36:35.425023 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.424847 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-home" (OuterVolumeSpecName: "home") pod "ee45a61c-34a0-4576-8965-de98dd19d0b6" (UID: "ee45a61c-34a0-4576-8965-de98dd19d0b6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:36:35.425138 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.425085 2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-home\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:36:35.425138 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.425100 2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-tmp-dir\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:36:35.425213 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.425131 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-model-cache" (OuterVolumeSpecName: "model-cache") pod "ee45a61c-34a0-4576-8965-de98dd19d0b6" (UID: "ee45a61c-34a0-4576-8965-de98dd19d0b6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:36:35.426940 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.426897 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-dshm" (OuterVolumeSpecName: "dshm") pod "ee45a61c-34a0-4576-8965-de98dd19d0b6" (UID: "ee45a61c-34a0-4576-8965-de98dd19d0b6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:36:35.427072 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.426993 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee45a61c-34a0-4576-8965-de98dd19d0b6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ee45a61c-34a0-4576-8965-de98dd19d0b6" (UID: "ee45a61c-34a0-4576-8965-de98dd19d0b6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:36:35.427218 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.427200 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee45a61c-34a0-4576-8965-de98dd19d0b6-kube-api-access-m6djd" (OuterVolumeSpecName: "kube-api-access-m6djd") pod "ee45a61c-34a0-4576-8965-de98dd19d0b6" (UID: "ee45a61c-34a0-4576-8965-de98dd19d0b6"). InnerVolumeSpecName "kube-api-access-m6djd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:36:35.472707 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.472670 2564 generic.go:356] "Generic (PLEG): container finished" podID="ee45a61c-34a0-4576-8965-de98dd19d0b6" containerID="19ca745108781ef05569957eab0ac23bb910fe680da40e86920d9d00042a2153" exitCode=0 Jul 06 21:36:35.472858 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.472763 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" event={"ID":"ee45a61c-34a0-4576-8965-de98dd19d0b6","Type":"ContainerDied","Data":"19ca745108781ef05569957eab0ac23bb910fe680da40e86920d9d00042a2153"} Jul 06 21:36:35.472858 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.472781 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" Jul 06 21:36:35.472858 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.472810 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh" event={"ID":"ee45a61c-34a0-4576-8965-de98dd19d0b6","Type":"ContainerDied","Data":"f2d1a216a49fc95dc043f2e045b9d6f162acf9f8aac5296c83951ca35a26b285"} Jul 06 21:36:35.472858 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.472833 2564 scope.go:117] "RemoveContainer" containerID="19ca745108781ef05569957eab0ac23bb910fe680da40e86920d9d00042a2153" Jul 06 21:36:35.474294 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.474099 2564 generic.go:356] "Generic (PLEG): container finished" podID="1f5b65f4-be54-4960-a5b0-40881cc1597b" containerID="c8c61a90e5d8a6ee47c27d3d41eacd87168c1cc3cb67a8a53c5f4f27b6f648df" exitCode=0 Jul 06 21:36:35.474294 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.474181 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" Jul 06 21:36:35.474294 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.474185 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" event={"ID":"1f5b65f4-be54-4960-a5b0-40881cc1597b","Type":"ContainerDied","Data":"c8c61a90e5d8a6ee47c27d3d41eacd87168c1cc3cb67a8a53c5f4f27b6f648df"} Jul 06 21:36:35.474294 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.474238 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl" event={"ID":"1f5b65f4-be54-4960-a5b0-40881cc1597b","Type":"ContainerDied","Data":"51fdb6db4db4e1d740a81df29d4a520f1ca9e28eeaee3d086c99dd6e773f7689"} Jul 06 21:36:35.482221 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.482206 2564 scope.go:117] "RemoveContainer" containerID="19ca745108781ef05569957eab0ac23bb910fe680da40e86920d9d00042a2153" Jul 06 21:36:35.482456 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:36:35.482438 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19ca745108781ef05569957eab0ac23bb910fe680da40e86920d9d00042a2153\": container with ID starting with 19ca745108781ef05569957eab0ac23bb910fe680da40e86920d9d00042a2153 not found: ID does not exist" containerID="19ca745108781ef05569957eab0ac23bb910fe680da40e86920d9d00042a2153" Jul 06 21:36:35.482524 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.482463 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19ca745108781ef05569957eab0ac23bb910fe680da40e86920d9d00042a2153"} err="failed to get container status \"19ca745108781ef05569957eab0ac23bb910fe680da40e86920d9d00042a2153\": rpc error: code = NotFound desc = could not find container \"19ca745108781ef05569957eab0ac23bb910fe680da40e86920d9d00042a2153\": container with ID starting with 19ca745108781ef05569957eab0ac23bb910fe680da40e86920d9d00042a2153 not found: ID does not exist" Jul 06 21:36:35.482524 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.482479 2564 scope.go:117] "RemoveContainer" containerID="c8c61a90e5d8a6ee47c27d3d41eacd87168c1cc3cb67a8a53c5f4f27b6f648df" Jul 06 21:36:35.490474 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.490453 2564 scope.go:117] "RemoveContainer" containerID="c8c61a90e5d8a6ee47c27d3d41eacd87168c1cc3cb67a8a53c5f4f27b6f648df" Jul 06 21:36:35.490747 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:36:35.490725 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8c61a90e5d8a6ee47c27d3d41eacd87168c1cc3cb67a8a53c5f4f27b6f648df\": container with ID starting with c8c61a90e5d8a6ee47c27d3d41eacd87168c1cc3cb67a8a53c5f4f27b6f648df not found: ID does not exist" containerID="c8c61a90e5d8a6ee47c27d3d41eacd87168c1cc3cb67a8a53c5f4f27b6f648df" Jul 06 21:36:35.490858 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.490750 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8c61a90e5d8a6ee47c27d3d41eacd87168c1cc3cb67a8a53c5f4f27b6f648df"} err="failed to get container status \"c8c61a90e5d8a6ee47c27d3d41eacd87168c1cc3cb67a8a53c5f4f27b6f648df\": rpc error: code = NotFound desc = could not find container \"c8c61a90e5d8a6ee47c27d3d41eacd87168c1cc3cb67a8a53c5f4f27b6f648df\": container with ID starting with c8c61a90e5d8a6ee47c27d3d41eacd87168c1cc3cb67a8a53c5f4f27b6f648df not found: ID does not exist" Jul 06 21:36:35.491087 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.491068 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl"] Jul 06 21:36:35.496930 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.496908 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-900ebe/auth-test-model-900ebe-kserve-7dd97954f5-jrrxl"] Jul 06 21:36:35.507593 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.507574 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh"] Jul 06 21:36:35.511386 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.511364 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-5ea078/auth-test-model-5ea078-kserve-56f867c67-bfngh"] Jul 06 21:36:35.526175 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.526158 2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-dshm\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:36:35.526247 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.526179 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6djd\" (UniqueName: \"kubernetes.io/projected/ee45a61c-34a0-4576-8965-de98dd19d0b6-kube-api-access-m6djd\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:36:35.526247 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.526192 2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee45a61c-34a0-4576-8965-de98dd19d0b6-tls-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:36:35.526247 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:35.526206 2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee45a61c-34a0-4576-8965-de98dd19d0b6-model-cache\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:36:37.029489 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:37.029452 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f5b65f4-be54-4960-a5b0-40881cc1597b" path="/var/lib/kubelet/pods/1f5b65f4-be54-4960-a5b0-40881cc1597b/volumes" Jul 06 21:36:37.029969 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:37.029893 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee45a61c-34a0-4576-8965-de98dd19d0b6" path="/var/lib/kubelet/pods/ee45a61c-34a0-4576-8965-de98dd19d0b6/volumes" Jul 06 21:36:42.840641 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:42.840603 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:36:55.357480 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.357445 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c"] Jul 06 21:36:55.357933 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.357824 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f5b65f4-be54-4960-a5b0-40881cc1597b" containerName="main" Jul 06 21:36:55.357933 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.357837 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f5b65f4-be54-4960-a5b0-40881cc1597b" containerName="main" Jul 06 21:36:55.357933 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.357843 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee45a61c-34a0-4576-8965-de98dd19d0b6" containerName="main" Jul 06 21:36:55.357933 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.357848 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee45a61c-34a0-4576-8965-de98dd19d0b6" containerName="main" Jul 06 21:36:55.357933 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.357911 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f5b65f4-be54-4960-a5b0-40881cc1597b" containerName="main" Jul 06 21:36:55.357933 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.357924 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee45a61c-34a0-4576-8965-de98dd19d0b6" containerName="main" Jul 06 21:36:55.362260 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.362245 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.365032 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.365006 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5ea078\"/\"openshift-service-ca.crt\"" Jul 06 21:36:55.366055 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.366036 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5ea078\"/\"kube-root-ca.crt\"" Jul 06 21:36:55.366130 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.366035 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5ea078\"/\"default-dockercfg-vdnqp\"" Jul 06 21:36:55.366130 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.366099 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5ea078\"/\"sub-test-model-5ea078-kserve-self-signed-certs\"" Jul 06 21:36:55.372635 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.372612 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c"] Jul 06 21:36:55.383401 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.383376 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:36:55.502420 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.502375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f622e22-e423-420a-901c-802bdeaa6d45-tls-certs\") pod \"sub-test-model-5ea078-kserve-5f65ff4667-dqz9c\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.502420 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.502418 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsrtm\" (UniqueName: \"kubernetes.io/projected/6f622e22-e423-420a-901c-802bdeaa6d45-kube-api-access-dsrtm\") pod \"sub-test-model-5ea078-kserve-5f65ff4667-dqz9c\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.502722 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.502443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-home\") pod \"sub-test-model-5ea078-kserve-5f65ff4667-dqz9c\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.502722 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.502552 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-model-cache\") pod \"sub-test-model-5ea078-kserve-5f65ff4667-dqz9c\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.502722 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.502600 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-dshm\") pod \"sub-test-model-5ea078-kserve-5f65ff4667-dqz9c\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.502722 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.502641 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-tmp-dir\") pod \"sub-test-model-5ea078-kserve-5f65ff4667-dqz9c\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.603894 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.603851 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f622e22-e423-420a-901c-802bdeaa6d45-tls-certs\") pod \"sub-test-model-5ea078-kserve-5f65ff4667-dqz9c\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.603894 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.603894 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsrtm\" (UniqueName: \"kubernetes.io/projected/6f622e22-e423-420a-901c-802bdeaa6d45-kube-api-access-dsrtm\") pod \"sub-test-model-5ea078-kserve-5f65ff4667-dqz9c\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.604123 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.604025 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-home\") pod \"sub-test-model-5ea078-kserve-5f65ff4667-dqz9c\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.604123 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.604072 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-model-cache\") pod \"sub-test-model-5ea078-kserve-5f65ff4667-dqz9c\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.604123 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.604111 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-dshm\") pod \"sub-test-model-5ea078-kserve-5f65ff4667-dqz9c\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.604243 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.604143 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-tmp-dir\") pod \"sub-test-model-5ea078-kserve-5f65ff4667-dqz9c\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.604520 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.604480 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-model-cache\") pod \"sub-test-model-5ea078-kserve-5f65ff4667-dqz9c\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.604716 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.604533 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-home\") pod \"sub-test-model-5ea078-kserve-5f65ff4667-dqz9c\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.604716 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.604568 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-tmp-dir\") pod \"sub-test-model-5ea078-kserve-5f65ff4667-dqz9c\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.606490 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.606466 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-dshm\") pod \"sub-test-model-5ea078-kserve-5f65ff4667-dqz9c\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.606706 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.606690 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f622e22-e423-420a-901c-802bdeaa6d45-tls-certs\") pod \"sub-test-model-5ea078-kserve-5f65ff4667-dqz9c\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.612853 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.612804 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsrtm\" (UniqueName: \"kubernetes.io/projected/6f622e22-e423-420a-901c-802bdeaa6d45-kube-api-access-dsrtm\") pod \"sub-test-model-5ea078-kserve-5f65ff4667-dqz9c\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.672379 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.672336 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:36:55.811309 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:55.811268 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c"] Jul 06 21:36:55.814070 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:36:55.814044 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f622e22_e423_420a_901c_802bdeaa6d45.slice/crio-7a1edc3bacdda7ed2cc075ff740055e4ef8f6fd458f59f75c9efa44aad6cc21c WatchSource:0}: Error finding container 7a1edc3bacdda7ed2cc075ff740055e4ef8f6fd458f59f75c9efa44aad6cc21c: Status 404 returned error can't find the container with id 7a1edc3bacdda7ed2cc075ff740055e4ef8f6fd458f59f75c9efa44aad6cc21c Jul 06 21:36:56.573076 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:56.573041 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" event={"ID":"6f622e22-e423-420a-901c-802bdeaa6d45","Type":"ContainerStarted","Data":"3c8c75080a24805e780991147a7685a6bd59468382d2d6070d04870f8d85f462"} Jul 06 21:36:56.573076 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:56.573085 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" event={"ID":"6f622e22-e423-420a-901c-802bdeaa6d45","Type":"ContainerStarted","Data":"7a1edc3bacdda7ed2cc075ff740055e4ef8f6fd458f59f75c9efa44aad6cc21c"} Jul 06 21:36:56.595108 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:56.595051 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" podStartSLOduration=1.5950347740000002 podStartE2EDuration="1.595034774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:36:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:36:56.593078148 +0000 UTC m=+2312.121926012" watchObservedRunningTime="2026-07-06 21:36:56.595034774 +0000 UTC m=+2312.123882573" Jul 06 21:36:59.897747 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:36:59.897703 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:37:05.672961 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:05.672921 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:37:05.673462 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:05.672981 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:37:05.685818 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:05.685790 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:37:06.631857 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:06.631823 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:37:19.037345 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:19.037311 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:37:36.958259 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:36.958224 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:37:42.493604 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:42.493560 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:37:43.345744 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:43.345709 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c"] Jul 06 21:37:43.364651 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:43.364613 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:37:53.145818 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:53.145780 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:37:54.454856 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:54.454795 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:37:54.555063 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:54.555032 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:37:55.545138 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.545103 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt"] Jul 06 21:37:55.548400 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.548382 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.551436 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.551410 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-900ebe\"/\"rate-test-model-900ebe-kserve-self-signed-certs\"" Jul 06 21:37:55.551657 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.551640 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-900ebe\"/\"kube-root-ca.crt\"" Jul 06 21:37:55.551735 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.551717 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-900ebe\"/\"default-dockercfg-b545d\"" Jul 06 21:37:55.551829 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.551809 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-900ebe\"/\"openshift-service-ca.crt\"" Jul 06 21:37:55.559377 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.559357 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt"] Jul 06 21:37:55.570913 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.570875 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:37:55.628545 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.628484 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-tmp-dir\") pod \"rate-test-model-900ebe-kserve-5cb5d84659-rgqkt\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.628729 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.628579 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-model-cache\") pod \"rate-test-model-900ebe-kserve-5cb5d84659-rgqkt\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.628729 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.628597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-tls-certs\") pod \"rate-test-model-900ebe-kserve-5cb5d84659-rgqkt\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.628729 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.628613 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjmwq\" (UniqueName: \"kubernetes.io/projected/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-kube-api-access-rjmwq\") pod \"rate-test-model-900ebe-kserve-5cb5d84659-rgqkt\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.628729 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.628632 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-home\") pod \"rate-test-model-900ebe-kserve-5cb5d84659-rgqkt\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.628729 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.628695 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-dshm\") pod \"rate-test-model-900ebe-kserve-5cb5d84659-rgqkt\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.730016 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.729976 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-model-cache\") pod \"rate-test-model-900ebe-kserve-5cb5d84659-rgqkt\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.730016 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.730012 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-tls-certs\") pod \"rate-test-model-900ebe-kserve-5cb5d84659-rgqkt\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.730272 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.730028 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjmwq\" (UniqueName: \"kubernetes.io/projected/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-kube-api-access-rjmwq\") pod \"rate-test-model-900ebe-kserve-5cb5d84659-rgqkt\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.730272 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.730048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-home\") pod \"rate-test-model-900ebe-kserve-5cb5d84659-rgqkt\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.730272 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.730072 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-dshm\") pod \"rate-test-model-900ebe-kserve-5cb5d84659-rgqkt\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.730272 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.730143 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-tmp-dir\") pod \"rate-test-model-900ebe-kserve-5cb5d84659-rgqkt\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.730459 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.730436 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-model-cache\") pod \"rate-test-model-900ebe-kserve-5cb5d84659-rgqkt\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.730529 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.730445 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-home\") pod \"rate-test-model-900ebe-kserve-5cb5d84659-rgqkt\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.730585 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.730566 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-tmp-dir\") pod \"rate-test-model-900ebe-kserve-5cb5d84659-rgqkt\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.732446 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.732424 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-dshm\") pod \"rate-test-model-900ebe-kserve-5cb5d84659-rgqkt\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.732743 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.732725 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-tls-certs\") pod \"rate-test-model-900ebe-kserve-5cb5d84659-rgqkt\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.739303 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.739281 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjmwq\" (UniqueName: \"kubernetes.io/projected/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-kube-api-access-rjmwq\") pod \"rate-test-model-900ebe-kserve-5cb5d84659-rgqkt\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.858131 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.858052 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:37:55.994233 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:55.994202 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt"] Jul 06 21:37:55.997091 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:37:55.997061 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b5c4faa_3a97_4184_a255_a1e1c949e7e4.slice/crio-35fafea316842c8391f2eea19d834952f623cbd9cec523d288d4cbd800795828 WatchSource:0}: Error finding container 35fafea316842c8391f2eea19d834952f623cbd9cec523d288d4cbd800795828: Status 404 returned error can't find the container with id 35fafea316842c8391f2eea19d834952f623cbd9cec523d288d4cbd800795828 Jul 06 21:37:56.852104 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:56.852070 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" event={"ID":"7b5c4faa-3a97-4184-a255-a1e1c949e7e4","Type":"ContainerStarted","Data":"031d3e279ee3a9905ccf06aac5931a95a72d48216f1f07765d5915637cf9556c"} Jul 06 21:37:56.852104 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:56.852111 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" event={"ID":"7b5c4faa-3a97-4184-a255-a1e1c949e7e4","Type":"ContainerStarted","Data":"35fafea316842c8391f2eea19d834952f623cbd9cec523d288d4cbd800795828"} Jul 06 21:37:56.871726 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:56.871678 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" podStartSLOduration=1.871657441 podStartE2EDuration="1.871657441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:37:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:37:56.869639893 +0000 UTC m=+2372.398487693" watchObservedRunningTime="2026-07-06 21:37:56.871657441 +0000 UTC m=+2372.400505239" Jul 06 21:37:58.366462 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.366394 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" podUID="6f622e22-e423-420a-901c-802bdeaa6d45" containerName="main" containerID="cri-o://3c8c75080a24805e780991147a7685a6bd59468382d2d6070d04870f8d85f462" gracePeriod=45 Jul 06 21:37:58.615702 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.615676 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:37:58.760530 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.760409 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-model-cache\") pod \"6f622e22-e423-420a-901c-802bdeaa6d45\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " Jul 06 21:37:58.760530 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.760459 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-home\") pod \"6f622e22-e423-420a-901c-802bdeaa6d45\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " Jul 06 21:37:58.760530 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.760481 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsrtm\" (UniqueName: \"kubernetes.io/projected/6f622e22-e423-420a-901c-802bdeaa6d45-kube-api-access-dsrtm\") pod \"6f622e22-e423-420a-901c-802bdeaa6d45\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " Jul 06 21:37:58.760815 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.760564 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f622e22-e423-420a-901c-802bdeaa6d45-tls-certs\") pod \"6f622e22-e423-420a-901c-802bdeaa6d45\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " Jul 06 21:37:58.760815 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.760609 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-dshm\") pod \"6f622e22-e423-420a-901c-802bdeaa6d45\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " Jul 06 21:37:58.760815 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.760623 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-tmp-dir\") pod \"6f622e22-e423-420a-901c-802bdeaa6d45\" (UID: \"6f622e22-e423-420a-901c-802bdeaa6d45\") " Jul 06 21:37:58.760815 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.760749 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-home" (OuterVolumeSpecName: "home") pod "6f622e22-e423-420a-901c-802bdeaa6d45" (UID: "6f622e22-e423-420a-901c-802bdeaa6d45"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:37:58.760815 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.760782 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-model-cache" (OuterVolumeSpecName: "model-cache") pod "6f622e22-e423-420a-901c-802bdeaa6d45" (UID: "6f622e22-e423-420a-901c-802bdeaa6d45"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:37:58.761041 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.760886 2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-home\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:37:58.761041 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.760905 2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-model-cache\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:37:58.761041 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.760987 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6f622e22-e423-420a-901c-802bdeaa6d45" (UID: "6f622e22-e423-420a-901c-802bdeaa6d45"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:37:58.762897 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.762869 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-dshm" (OuterVolumeSpecName: "dshm") pod "6f622e22-e423-420a-901c-802bdeaa6d45" (UID: "6f622e22-e423-420a-901c-802bdeaa6d45"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:37:58.763037 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.762886 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f622e22-e423-420a-901c-802bdeaa6d45-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6f622e22-e423-420a-901c-802bdeaa6d45" (UID: "6f622e22-e423-420a-901c-802bdeaa6d45"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:37:58.763037 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.762998 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f622e22-e423-420a-901c-802bdeaa6d45-kube-api-access-dsrtm" (OuterVolumeSpecName: "kube-api-access-dsrtm") pod "6f622e22-e423-420a-901c-802bdeaa6d45" (UID: "6f622e22-e423-420a-901c-802bdeaa6d45"). InnerVolumeSpecName "kube-api-access-dsrtm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:37:58.861373 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.861338 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsrtm\" (UniqueName: \"kubernetes.io/projected/6f622e22-e423-420a-901c-802bdeaa6d45-kube-api-access-dsrtm\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:37:58.861373 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.861369 2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f622e22-e423-420a-901c-802bdeaa6d45-tls-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:37:58.861373 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.861381 2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-dshm\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:37:58.861638 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.861392 2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f622e22-e423-420a-901c-802bdeaa6d45-tmp-dir\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:37:58.863642 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.863616 2564 generic.go:356] "Generic (PLEG): container finished" podID="6f622e22-e423-420a-901c-802bdeaa6d45" containerID="3c8c75080a24805e780991147a7685a6bd59468382d2d6070d04870f8d85f462" exitCode=0 Jul 06 21:37:58.863747 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.863663 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" Jul 06 21:37:58.863747 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.863696 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" event={"ID":"6f622e22-e423-420a-901c-802bdeaa6d45","Type":"ContainerDied","Data":"3c8c75080a24805e780991147a7685a6bd59468382d2d6070d04870f8d85f462"} Jul 06 21:37:58.863747 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.863733 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c" event={"ID":"6f622e22-e423-420a-901c-802bdeaa6d45","Type":"ContainerDied","Data":"7a1edc3bacdda7ed2cc075ff740055e4ef8f6fd458f59f75c9efa44aad6cc21c"} Jul 06 21:37:58.863863 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.863768 2564 scope.go:117] "RemoveContainer" containerID="3c8c75080a24805e780991147a7685a6bd59468382d2d6070d04870f8d85f462" Jul 06 21:37:58.872881 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.872861 2564 scope.go:117] "RemoveContainer" containerID="3c8c75080a24805e780991147a7685a6bd59468382d2d6070d04870f8d85f462" Jul 06 21:37:58.873115 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:37:58.873083 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c8c75080a24805e780991147a7685a6bd59468382d2d6070d04870f8d85f462\": container with ID starting with 3c8c75080a24805e780991147a7685a6bd59468382d2d6070d04870f8d85f462 not found: ID does not exist" containerID="3c8c75080a24805e780991147a7685a6bd59468382d2d6070d04870f8d85f462" Jul 06 21:37:58.873212 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.873114 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c8c75080a24805e780991147a7685a6bd59468382d2d6070d04870f8d85f462"} err="failed to get container status \"3c8c75080a24805e780991147a7685a6bd59468382d2d6070d04870f8d85f462\": rpc error: code = NotFound desc = could not find container \"3c8c75080a24805e780991147a7685a6bd59468382d2d6070d04870f8d85f462\": container with ID starting with 3c8c75080a24805e780991147a7685a6bd59468382d2d6070d04870f8d85f462 not found: ID does not exist" Jul 06 21:37:58.887027 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.887001 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c"] Jul 06 21:37:58.892136 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:58.892110 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-5ea078/sub-test-model-5ea078-kserve-5f65ff4667-dqz9c"] Jul 06 21:37:59.028640 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:37:59.028598 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f622e22-e423-420a-901c-802bdeaa6d45" path="/var/lib/kubelet/pods/6f622e22-e423-420a-901c-802bdeaa6d45/volumes" Jul 06 21:38:04.546587 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:04.546553 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:38:05.859202 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:05.859169 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:38:05.859622 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:05.859369 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:38:05.871605 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:05.871579 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:38:05.907141 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:05.907118 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:38:17.282512 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.282460 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf"] Jul 06 21:38:17.283532 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.283486 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f622e22-e423-420a-901c-802bdeaa6d45" containerName="main" Jul 06 21:38:17.284709 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.283711 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f622e22-e423-420a-901c-802bdeaa6d45" containerName="main" Jul 06 21:38:17.284709 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.284044 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f622e22-e423-420a-901c-802bdeaa6d45" containerName="main" Jul 06 21:38:17.289483 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.288465 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.291590 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.291567 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5ea078\"/\"openshift-service-ca.crt\"" Jul 06 21:38:17.292508 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.292476 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5ea078\"/\"kube-root-ca.crt\"" Jul 06 21:38:17.292597 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.292538 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5ea078\"/\"rate-test-model-5ea078-kserve-self-signed-certs\"" Jul 06 21:38:17.292646 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.292539 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5ea078\"/\"default-dockercfg-vdnqp\"" Jul 06 21:38:17.297308 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.297283 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf"] Jul 06 21:38:17.318369 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.318335 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:38:17.318953 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.318930 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91fe135e-6685-40cb-b523-005c5a160ddc-tls-certs\") pod \"rate-test-model-5ea078-kserve-9f9bdd795-ll5sf\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.319096 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.318992 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsdln\" (UniqueName: \"kubernetes.io/projected/91fe135e-6685-40cb-b523-005c5a160ddc-kube-api-access-dsdln\") pod \"rate-test-model-5ea078-kserve-9f9bdd795-ll5sf\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.319096 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.319043 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-dshm\") pod \"rate-test-model-5ea078-kserve-9f9bdd795-ll5sf\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.319219 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.319122 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-home\") pod \"rate-test-model-5ea078-kserve-9f9bdd795-ll5sf\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.319219 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.319165 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-tmp-dir\") pod \"rate-test-model-5ea078-kserve-9f9bdd795-ll5sf\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.319219 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.319200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-model-cache\") pod \"rate-test-model-5ea078-kserve-9f9bdd795-ll5sf\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.420636 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.420601 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-home\") pod \"rate-test-model-5ea078-kserve-9f9bdd795-ll5sf\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.420636 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.420638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-tmp-dir\") pod \"rate-test-model-5ea078-kserve-9f9bdd795-ll5sf\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.420902 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.420669 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-model-cache\") pod \"rate-test-model-5ea078-kserve-9f9bdd795-ll5sf\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.420902 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.420709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91fe135e-6685-40cb-b523-005c5a160ddc-tls-certs\") pod \"rate-test-model-5ea078-kserve-9f9bdd795-ll5sf\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.420902 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.420745 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsdln\" (UniqueName: \"kubernetes.io/projected/91fe135e-6685-40cb-b523-005c5a160ddc-kube-api-access-dsdln\") pod \"rate-test-model-5ea078-kserve-9f9bdd795-ll5sf\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.420902 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.420768 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-dshm\") pod \"rate-test-model-5ea078-kserve-9f9bdd795-ll5sf\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.421116 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.421049 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-home\") pod \"rate-test-model-5ea078-kserve-9f9bdd795-ll5sf\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.421173 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.421114 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-tmp-dir\") pod \"rate-test-model-5ea078-kserve-9f9bdd795-ll5sf\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.421173 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.421131 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-model-cache\") pod \"rate-test-model-5ea078-kserve-9f9bdd795-ll5sf\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.423274 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.423243 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-dshm\") pod \"rate-test-model-5ea078-kserve-9f9bdd795-ll5sf\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.423469 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.423447 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91fe135e-6685-40cb-b523-005c5a160ddc-tls-certs\") pod \"rate-test-model-5ea078-kserve-9f9bdd795-ll5sf\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.432962 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.432936 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsdln\" (UniqueName: \"kubernetes.io/projected/91fe135e-6685-40cb-b523-005c5a160ddc-kube-api-access-dsdln\") pod \"rate-test-model-5ea078-kserve-9f9bdd795-ll5sf\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.599522 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.599401 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:17.737375 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.737347 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf"] Jul 06 21:38:17.739791 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:38:17.739762 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91fe135e_6685_40cb_b523_005c5a160ddc.slice/crio-c35a460acb914249e6ea6987b43062d3175c5edd78656b76dcd96b2b793b1353 WatchSource:0}: Error finding container c35a460acb914249e6ea6987b43062d3175c5edd78656b76dcd96b2b793b1353: Status 404 returned error can't find the container with id c35a460acb914249e6ea6987b43062d3175c5edd78656b76dcd96b2b793b1353 Jul 06 21:38:17.950086 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.949980 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" event={"ID":"91fe135e-6685-40cb-b523-005c5a160ddc","Type":"ContainerStarted","Data":"c84ef6ac8440dc6410418a134bad360da022a8d59a68250a66ab2d7ca0f05871"} Jul 06 21:38:17.950086 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.950030 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" event={"ID":"91fe135e-6685-40cb-b523-005c5a160ddc","Type":"ContainerStarted","Data":"c35a460acb914249e6ea6987b43062d3175c5edd78656b76dcd96b2b793b1353"} Jul 06 21:38:17.967519 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:17.967439 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" podStartSLOduration=0.967422369 podStartE2EDuration="967.422369ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:38:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:38:17.966670834 +0000 UTC m=+2393.495518633" watchObservedRunningTime="2026-07-06 21:38:17.967422369 +0000 UTC m=+2393.496270168" Jul 06 21:38:21.147775 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:21.147739 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:38:25.152248 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:25.152217 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:38:25.156102 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:25.156070 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 21:38:25.162841 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:25.162801 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:38:25.163436 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:25.163419 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 21:38:25.166265 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:25.166247 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 21:38:25.173348 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:25.173330 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbknp_41b93806-bd40-4596-b076-ef109dd4e9a7/ovn-acl-logging/0.log" Jul 06 21:38:27.600529 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:27.600460 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:27.600980 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:27.600544 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:27.613162 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:27.613138 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:28.009189 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:28.009100 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:38:40.454818 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:40.454773 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:38:53.750113 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:53.750034 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:38:55.008733 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:55.008699 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:38:55.107755 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:38:55.107720 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:00.659465 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:00.659434 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt"] Jul 06 21:39:00.676773 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:00.676735 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:01.546927 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:01.546884 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf"] Jul 06 21:39:01.563783 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:01.563738 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:02.626301 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:02.626267 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:03.028123 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:03.028083 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:03.637539 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:03.637479 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:03.733684 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:03.733649 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:03.933799 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:03.933717 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:07.961450 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:07.961410 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:39:08.124879 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:08.124845 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:15.679873 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:15.679809 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" podUID="7b5c4faa-3a97-4184-a255-a1e1c949e7e4" containerName="main" containerID="cri-o://031d3e279ee3a9905ccf06aac5931a95a72d48216f1f07765d5915637cf9556c" gracePeriod=45 Jul 06 21:39:15.933371 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:15.933317 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:39:16.076913 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.076874 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-dshm\") pod \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " Jul 06 21:39:16.076913 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.076917 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-model-cache\") pod \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " Jul 06 21:39:16.077172 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.076945 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-home\") pod \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " Jul 06 21:39:16.077172 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.076982 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-tmp-dir\") pod \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " Jul 06 21:39:16.077172 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.077006 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-tls-certs\") pod \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " Jul 06 21:39:16.077172 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.077065 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjmwq\" (UniqueName: \"kubernetes.io/projected/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-kube-api-access-rjmwq\") pod \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\" (UID: \"7b5c4faa-3a97-4184-a255-a1e1c949e7e4\") " Jul 06 21:39:16.077364 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.077192 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-model-cache" (OuterVolumeSpecName: "model-cache") pod "7b5c4faa-3a97-4184-a255-a1e1c949e7e4" (UID: "7b5c4faa-3a97-4184-a255-a1e1c949e7e4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:39:16.077364 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.077265 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-home" (OuterVolumeSpecName: "home") pod "7b5c4faa-3a97-4184-a255-a1e1c949e7e4" (UID: "7b5c4faa-3a97-4184-a255-a1e1c949e7e4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:39:16.077364 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.077282 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7b5c4faa-3a97-4184-a255-a1e1c949e7e4" (UID: "7b5c4faa-3a97-4184-a255-a1e1c949e7e4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:39:16.077594 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.077384 2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-model-cache\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:39:16.077594 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.077414 2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-home\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:39:16.077594 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.077442 2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-tmp-dir\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:39:16.079258 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.079227 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-dshm" (OuterVolumeSpecName: "dshm") pod "7b5c4faa-3a97-4184-a255-a1e1c949e7e4" (UID: "7b5c4faa-3a97-4184-a255-a1e1c949e7e4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:39:16.079374 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.079258 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7b5c4faa-3a97-4184-a255-a1e1c949e7e4" (UID: "7b5c4faa-3a97-4184-a255-a1e1c949e7e4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:39:16.079374 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.079279 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-kube-api-access-rjmwq" (OuterVolumeSpecName: "kube-api-access-rjmwq") pod "7b5c4faa-3a97-4184-a255-a1e1c949e7e4" (UID: "7b5c4faa-3a97-4184-a255-a1e1c949e7e4"). InnerVolumeSpecName "kube-api-access-rjmwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:39:16.178486 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.178447 2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-tls-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:39:16.178486 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.178477 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjmwq\" (UniqueName: \"kubernetes.io/projected/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-kube-api-access-rjmwq\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:39:16.178486 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.178489 2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b5c4faa-3a97-4184-a255-a1e1c949e7e4-dshm\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:39:16.233732 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.233649 2564 generic.go:356] "Generic (PLEG): container finished" podID="7b5c4faa-3a97-4184-a255-a1e1c949e7e4" containerID="031d3e279ee3a9905ccf06aac5931a95a72d48216f1f07765d5915637cf9556c" exitCode=0 Jul 06 21:39:16.233732 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.233694 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" Jul 06 21:39:16.233906 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.233739 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" event={"ID":"7b5c4faa-3a97-4184-a255-a1e1c949e7e4","Type":"ContainerDied","Data":"031d3e279ee3a9905ccf06aac5931a95a72d48216f1f07765d5915637cf9556c"} Jul 06 21:39:16.233906 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.233780 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" event={"ID":"7b5c4faa-3a97-4184-a255-a1e1c949e7e4","Type":"ContainerDied","Data":"35fafea316842c8391f2eea19d834952f623cbd9cec523d288d4cbd800795828"} Jul 06 21:39:16.233906 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.233798 2564 scope.go:117] "RemoveContainer" containerID="031d3e279ee3a9905ccf06aac5931a95a72d48216f1f07765d5915637cf9556c" Jul 06 21:39:16.242969 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.242949 2564 scope.go:117] "RemoveContainer" containerID="031d3e279ee3a9905ccf06aac5931a95a72d48216f1f07765d5915637cf9556c" Jul 06 21:39:16.243227 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:39:16.243209 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"031d3e279ee3a9905ccf06aac5931a95a72d48216f1f07765d5915637cf9556c\": container with ID starting with 031d3e279ee3a9905ccf06aac5931a95a72d48216f1f07765d5915637cf9556c not found: ID does not exist" containerID="031d3e279ee3a9905ccf06aac5931a95a72d48216f1f07765d5915637cf9556c" Jul 06 21:39:16.243295 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.243236 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"031d3e279ee3a9905ccf06aac5931a95a72d48216f1f07765d5915637cf9556c"} err="failed to get container status \"031d3e279ee3a9905ccf06aac5931a95a72d48216f1f07765d5915637cf9556c\": rpc error: code = NotFound desc = could not find container \"031d3e279ee3a9905ccf06aac5931a95a72d48216f1f07765d5915637cf9556c\": container with ID starting with 031d3e279ee3a9905ccf06aac5931a95a72d48216f1f07765d5915637cf9556c not found: ID does not exist" Jul 06 21:39:16.264162 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.264133 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt"] Jul 06 21:39:16.269921 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.269896 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt"] Jul 06 21:39:16.567474 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.567437 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" podUID="91fe135e-6685-40cb-b523-005c5a160ddc" containerName="main" containerID="cri-o://c84ef6ac8440dc6410418a134bad360da022a8d59a68250a66ab2d7ca0f05871" gracePeriod=45 Jul 06 21:39:16.821333 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.821272 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:39:16.885369 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.885341 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-dshm\") pod \"91fe135e-6685-40cb-b523-005c5a160ddc\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " Jul 06 21:39:16.885550 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.885391 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-model-cache\") pod \"91fe135e-6685-40cb-b523-005c5a160ddc\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " Jul 06 21:39:16.885550 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.885420 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsdln\" (UniqueName: \"kubernetes.io/projected/91fe135e-6685-40cb-b523-005c5a160ddc-kube-api-access-dsdln\") pod \"91fe135e-6685-40cb-b523-005c5a160ddc\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " Jul 06 21:39:16.885550 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.885487 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-home\") pod \"91fe135e-6685-40cb-b523-005c5a160ddc\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " Jul 06 21:39:16.885550 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.885542 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91fe135e-6685-40cb-b523-005c5a160ddc-tls-certs\") pod \"91fe135e-6685-40cb-b523-005c5a160ddc\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " Jul 06 21:39:16.885776 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.885575 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-tmp-dir\") pod \"91fe135e-6685-40cb-b523-005c5a160ddc\" (UID: \"91fe135e-6685-40cb-b523-005c5a160ddc\") " Jul 06 21:39:16.885776 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.885716 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-model-cache" (OuterVolumeSpecName: "model-cache") pod "91fe135e-6685-40cb-b523-005c5a160ddc" (UID: "91fe135e-6685-40cb-b523-005c5a160ddc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:39:16.885776 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.885760 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-home" (OuterVolumeSpecName: "home") pod "91fe135e-6685-40cb-b523-005c5a160ddc" (UID: "91fe135e-6685-40cb-b523-005c5a160ddc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:39:16.885921 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.885883 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "91fe135e-6685-40cb-b523-005c5a160ddc" (UID: "91fe135e-6685-40cb-b523-005c5a160ddc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:39:16.885981 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.885939 2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-home\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:39:16.885981 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.885959 2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-model-cache\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:39:16.887705 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.887671 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91fe135e-6685-40cb-b523-005c5a160ddc-kube-api-access-dsdln" (OuterVolumeSpecName: "kube-api-access-dsdln") pod "91fe135e-6685-40cb-b523-005c5a160ddc" (UID: "91fe135e-6685-40cb-b523-005c5a160ddc"). InnerVolumeSpecName "kube-api-access-dsdln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:39:16.887790 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.887715 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-dshm" (OuterVolumeSpecName: "dshm") pod "91fe135e-6685-40cb-b523-005c5a160ddc" (UID: "91fe135e-6685-40cb-b523-005c5a160ddc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:39:16.887790 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.887713 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91fe135e-6685-40cb-b523-005c5a160ddc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "91fe135e-6685-40cb-b523-005c5a160ddc" (UID: "91fe135e-6685-40cb-b523-005c5a160ddc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:39:16.987330 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.987282 2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91fe135e-6685-40cb-b523-005c5a160ddc-tls-certs\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:39:16.987330 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.987325 2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-tmp-dir\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:39:16.987330 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.987334 2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91fe135e-6685-40cb-b523-005c5a160ddc-dshm\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:39:16.987330 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:16.987343 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsdln\" (UniqueName: \"kubernetes.io/projected/91fe135e-6685-40cb-b523-005c5a160ddc-kube-api-access-dsdln\") on node \"ip-10-0-131-226.ec2.internal\" DevicePath \"\"" Jul 06 21:39:17.029209 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:17.029168 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b5c4faa-3a97-4184-a255-a1e1c949e7e4" path="/var/lib/kubelet/pods/7b5c4faa-3a97-4184-a255-a1e1c949e7e4/volumes" Jul 06 21:39:17.240115 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:17.240031 2564 generic.go:356] "Generic (PLEG): container finished" podID="91fe135e-6685-40cb-b523-005c5a160ddc" containerID="c84ef6ac8440dc6410418a134bad360da022a8d59a68250a66ab2d7ca0f05871" exitCode=0 Jul 06 21:39:17.240115 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:17.240076 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" Jul 06 21:39:17.240309 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:17.240077 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" event={"ID":"91fe135e-6685-40cb-b523-005c5a160ddc","Type":"ContainerDied","Data":"c84ef6ac8440dc6410418a134bad360da022a8d59a68250a66ab2d7ca0f05871"} Jul 06 21:39:17.240309 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:17.240196 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf" event={"ID":"91fe135e-6685-40cb-b523-005c5a160ddc","Type":"ContainerDied","Data":"c35a460acb914249e6ea6987b43062d3175c5edd78656b76dcd96b2b793b1353"} Jul 06 21:39:17.240309 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:17.240218 2564 scope.go:117] "RemoveContainer" containerID="c84ef6ac8440dc6410418a134bad360da022a8d59a68250a66ab2d7ca0f05871" Jul 06 21:39:17.248794 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:17.248782 2564 scope.go:117] "RemoveContainer" containerID="c84ef6ac8440dc6410418a134bad360da022a8d59a68250a66ab2d7ca0f05871" Jul 06 21:39:17.249074 ip-10-0-131-226 kubenswrapper[2564]: E0706 21:39:17.249051 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c84ef6ac8440dc6410418a134bad360da022a8d59a68250a66ab2d7ca0f05871\": container with ID starting with c84ef6ac8440dc6410418a134bad360da022a8d59a68250a66ab2d7ca0f05871 not found: ID does not exist" containerID="c84ef6ac8440dc6410418a134bad360da022a8d59a68250a66ab2d7ca0f05871" Jul 06 21:39:17.249155 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:17.249082 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c84ef6ac8440dc6410418a134bad360da022a8d59a68250a66ab2d7ca0f05871"} err="failed to get container status \"c84ef6ac8440dc6410418a134bad360da022a8d59a68250a66ab2d7ca0f05871\": rpc error: code = NotFound desc = could not find container \"c84ef6ac8440dc6410418a134bad360da022a8d59a68250a66ab2d7ca0f05871\": container with ID starting with c84ef6ac8440dc6410418a134bad360da022a8d59a68250a66ab2d7ca0f05871 not found: ID does not exist" Jul 06 21:39:17.260361 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:17.260328 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf"] Jul 06 21:39:17.266362 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:17.266338 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-5ea078/rate-test-model-5ea078-kserve-9f9bdd795-ll5sf"] Jul 06 21:39:19.029087 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:19.029051 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91fe135e-6685-40cb-b523-005c5a160ddc" path="/var/lib/kubelet/pods/91fe135e-6685-40cb-b523-005c5a160ddc/volumes" Jul 06 21:39:20.897454 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:20.897385 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-900ebe/rate-test-model-900ebe-kserve-5cb5d84659-rgqkt" podUID="7b5c4faa-3a97-4184-a255-a1e1c949e7e4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.41:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jul 06 21:39:44.988625 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:44.988586 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:45.297133 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:45.297084 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:45.513833 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:45.513795 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:45.680679 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:45.680581 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:46.021407 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:46.021318 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:46.122054 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:46.122010 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:48.551824 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:48.551785 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nmc6h"] Jul 06 21:39:52.199256 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:52.199218 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:52.267272 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:52.267242 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:52.477846 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:52.477746 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:52.734925 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:52.734824 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:53.196327 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:53.196290 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68cffc5448-7pl2x_7f7b1f6a-4dca-448e-aa52-654634a1c9aa/authorino/0.log" Jul 06 21:39:56.848265 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:56.848230 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:39:59.092612 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:59.092578 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bd9f97986-gc8w4_64383df9-e442-470c-b813-92a765e3d99a/copy-manifests/0.log" Jul 06 21:39:59.100998 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:39:59.100975 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bd9f97986-gc8w4_64383df9-e442-470c-b813-92a765e3d99a/manager/0.log" Jul 06 21:40:00.703702 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:00.703674 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68cffc5448-7pl2x_7f7b1f6a-4dca-448e-aa52-654634a1c9aa/authorino/0.log" Jul 06 21:40:01.077563 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:01.077538 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zf6fr_d2a4b9ef-8333-41d5-9f82-c395f31376b8/kuadrant-console-plugin/0.log" Jul 06 21:40:01.451393 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:01.451318 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nmc6h_57ba510c-3a32-4c0d-9ca8-3a22de30fed5/limitador/0.log" Jul 06 21:40:02.162393 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:02.162359 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686455847d-lm59s_5881c4aa-faa0-4d05-b904-bbdf564bd48c/kube-auth-proxy/0.log" Jul 06 21:40:02.765469 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:02.765438 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7df99b5f7c-g9r85_a1772b59-30ba-434b-b201-19ab05b7f824/router/0.log" Jul 06 21:40:03.622232 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:03.622203 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-np77l_62d77b0f-0a49-4247-8a08-a0dd2e80c37f/main/0.log" Jul 06 21:40:03.747106 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:03.747076 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-bztzj_c01791a0-180b-4542-8735-4897143b180c/main/0.log" Jul 06 21:40:07.882656 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:07.882619 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-64qs2/must-gather-mvf59"] Jul 06 21:40:07.883120 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:07.882964 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5c4faa-3a97-4184-a255-a1e1c949e7e4" containerName="main" Jul 06 21:40:07.883120 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:07.882977 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5c4faa-3a97-4184-a255-a1e1c949e7e4" containerName="main" Jul 06 21:40:07.883120 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:07.882999 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91fe135e-6685-40cb-b523-005c5a160ddc" containerName="main" Jul 06 21:40:07.883120 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:07.883005 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="91fe135e-6685-40cb-b523-005c5a160ddc" containerName="main" Jul 06 21:40:07.883120 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:07.883063 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b5c4faa-3a97-4184-a255-a1e1c949e7e4" containerName="main" Jul 06 21:40:07.883120 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:07.883070 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="91fe135e-6685-40cb-b523-005c5a160ddc" containerName="main" Jul 06 21:40:07.885674 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:07.885655 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-64qs2/must-gather-mvf59" Jul 06 21:40:07.888540 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:07.888513 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-64qs2\"/\"default-dockercfg-hh7hq\"" Jul 06 21:40:07.888801 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:07.888778 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-64qs2\"/\"kube-root-ca.crt\"" Jul 06 21:40:07.888933 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:07.888778 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-64qs2\"/\"openshift-service-ca.crt\"" Jul 06 21:40:07.889172 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:07.889149 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:40:07.902081 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:07.902046 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-64qs2/must-gather-mvf59"] Jul 06 21:40:07.958023 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:07.957988 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" limit=1024 Jul 06 21:40:08.048559 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:08.048487 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bf240912-aed0-4716-8913-e641e0b486b8-must-gather-output\") pod \"must-gather-mvf59\" (UID: \"bf240912-aed0-4716-8913-e641e0b486b8\") " pod="openshift-must-gather-64qs2/must-gather-mvf59" Jul 06 21:40:08.048747 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:08.048630 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmdfg\" (UniqueName: \"kubernetes.io/projected/bf240912-aed0-4716-8913-e641e0b486b8-kube-api-access-hmdfg\") pod \"must-gather-mvf59\" (UID: \"bf240912-aed0-4716-8913-e641e0b486b8\") " pod="openshift-must-gather-64qs2/must-gather-mvf59" Jul 06 21:40:08.149311 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:08.149212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bf240912-aed0-4716-8913-e641e0b486b8-must-gather-output\") pod \"must-gather-mvf59\" (UID: \"bf240912-aed0-4716-8913-e641e0b486b8\") " pod="openshift-must-gather-64qs2/must-gather-mvf59" Jul 06 21:40:08.149311 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:08.149272 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmdfg\" (UniqueName: \"kubernetes.io/projected/bf240912-aed0-4716-8913-e641e0b486b8-kube-api-access-hmdfg\") pod \"must-gather-mvf59\" (UID: \"bf240912-aed0-4716-8913-e641e0b486b8\") " pod="openshift-must-gather-64qs2/must-gather-mvf59" Jul 06 21:40:08.149640 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:08.149618 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bf240912-aed0-4716-8913-e641e0b486b8-must-gather-output\") pod \"must-gather-mvf59\" (UID: \"bf240912-aed0-4716-8913-e641e0b486b8\") " pod="openshift-must-gather-64qs2/must-gather-mvf59" Jul 06 21:40:08.159217 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:08.159172 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmdfg\" (UniqueName: \"kubernetes.io/projected/bf240912-aed0-4716-8913-e641e0b486b8-kube-api-access-hmdfg\") pod \"must-gather-mvf59\" (UID: \"bf240912-aed0-4716-8913-e641e0b486b8\") " pod="openshift-must-gather-64qs2/must-gather-mvf59" Jul 06 21:40:08.195237 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:08.195198 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-64qs2/must-gather-mvf59" Jul 06 21:40:08.334125 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:08.334093 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-64qs2/must-gather-mvf59"] Jul 06 21:40:08.336598 ip-10-0-131-226 kubenswrapper[2564]: W0706 21:40:08.336571 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf240912_aed0_4716_8913_e641e0b486b8.slice/crio-0c69d4f7c6cb9b3a9095fdb6d4b0782fe03d662c226c8e1d0f6fc76975fc4cc1 WatchSource:0}: Error finding container 0c69d4f7c6cb9b3a9095fdb6d4b0782fe03d662c226c8e1d0f6fc76975fc4cc1: Status 404 returned error can't find the container with id 0c69d4f7c6cb9b3a9095fdb6d4b0782fe03d662c226c8e1d0f6fc76975fc4cc1 Jul 06 21:40:08.338477 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:08.338460 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 21:40:08.485372 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:08.485284 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-64qs2/must-gather-mvf59" event={"ID":"bf240912-aed0-4716-8913-e641e0b486b8","Type":"ContainerStarted","Data":"0c69d4f7c6cb9b3a9095fdb6d4b0782fe03d662c226c8e1d0f6fc76975fc4cc1"} Jul 06 21:40:09.495451 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:09.494848 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-64qs2/must-gather-mvf59" event={"ID":"bf240912-aed0-4716-8913-e641e0b486b8","Type":"ContainerStarted","Data":"5cf913502b8c9956bac341b300aafb98d8fcdfcd6d6feba744c913cd151d71fb"} Jul 06 21:40:10.504233 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:10.504191 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-64qs2/must-gather-mvf59" event={"ID":"bf240912-aed0-4716-8913-e641e0b486b8","Type":"ContainerStarted","Data":"a7812ccbcb7152869d205db1d16c2f037192911ed920aa044ed8907b55b32690"} Jul 06 21:40:10.523397 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:10.523344 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-64qs2/must-gather-mvf59" podStartSLOduration=2.501721185 podStartE2EDuration="3.523323503s" totalImagesPullingTime="1.021602318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:40:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:40:10.523267912 +0000 UTC m=+2506.052115713" watchObservedRunningTime="2026-07-06 21:40:10.523323503 +0000 UTC m=+2506.052171301" Jul 06 21:40:11.170118 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:11.170084 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f4zwn_af7599f6-9dd4-4114-9924-17189fb49188/global-pull-secret-syncer/0.log" Jul 06 21:40:11.279741 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:11.279648 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6fb64_14dfea34-a9cf-4d9a-a693-240ffbadeff1/konnectivity-agent/0.log" Jul 06 21:40:11.387458 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:11.387426 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-226.ec2.internal_5f2626d80cf6adaad426dfc2322e4da8/haproxy/0.log" Jul 06 21:40:16.647070 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:16.644174 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68cffc5448-7pl2x_7f7b1f6a-4dca-448e-aa52-654634a1c9aa/authorino/0.log" Jul 06 21:40:16.734248 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:16.734205 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zf6fr_d2a4b9ef-8333-41d5-9f82-c395f31376b8/kuadrant-console-plugin/0.log" Jul 06 21:40:16.944644 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:16.944556 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nmc6h_57ba510c-3a32-4c0d-9ca8-3a22de30fed5/limitador/0.log" Jul 06 21:40:18.945596 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:18.945481 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/2.log" Jul 06 21:40:19.053285 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:19.053249 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-slfss_f42135c2-6517-4bbf-a412-acb2e43c9b8c/cluster-monitoring-operator/1.log" Jul 06 21:40:19.166700 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:19.166648 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7f79777d44-bs4sb_aa1e3a87-e583-4da5-b5db-f4f6cb0f6b23/metrics-server/0.log" Jul 06 21:40:19.408806 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:19.408766 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vclsq_d78f8081-8e10-4fbf-ac97-73ab2f9b5666/node-exporter/0.log" Jul 06 21:40:19.432431 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:19.432398 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vclsq_d78f8081-8e10-4fbf-ac97-73ab2f9b5666/kube-rbac-proxy/0.log" Jul 06 21:40:19.457300 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:19.457271 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vclsq_d78f8081-8e10-4fbf-ac97-73ab2f9b5666/init-textfile/0.log" Jul 06 21:40:19.863884 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:19.863856 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c7ccfd659-9cjpc_fca0c04b-c7ef-4be5-988e-7eea2e83159d/telemeter-client/0.log" Jul 06 21:40:19.890279 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:19.890250 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c7ccfd659-9cjpc_fca0c04b-c7ef-4be5-988e-7eea2e83159d/reload/0.log" Jul 06 21:40:19.914894 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:19.914862 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c7ccfd659-9cjpc_fca0c04b-c7ef-4be5-988e-7eea2e83159d/kube-rbac-proxy/0.log" Jul 06 21:40:21.560759 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.560723 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm"] Jul 06 21:40:21.566727 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.566696 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:21.579170 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.579132 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm"] Jul 06 21:40:21.603342 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.603291 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66b99e2b-9334-4078-8814-8866b6667387-proc\") pod \"perf-node-gather-daemonset-2q5pm\" (UID: \"66b99e2b-9334-4078-8814-8866b6667387\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:21.603342 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.603341 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6srb\" (UniqueName: \"kubernetes.io/projected/66b99e2b-9334-4078-8814-8866b6667387-kube-api-access-g6srb\") pod \"perf-node-gather-daemonset-2q5pm\" (UID: \"66b99e2b-9334-4078-8814-8866b6667387\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:21.603634 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.603382 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66b99e2b-9334-4078-8814-8866b6667387-podres\") pod \"perf-node-gather-daemonset-2q5pm\" (UID: \"66b99e2b-9334-4078-8814-8866b6667387\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:21.603634 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.603444 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66b99e2b-9334-4078-8814-8866b6667387-lib-modules\") pod \"perf-node-gather-daemonset-2q5pm\" (UID: \"66b99e2b-9334-4078-8814-8866b6667387\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:21.603634 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.603525 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66b99e2b-9334-4078-8814-8866b6667387-sys\") pod \"perf-node-gather-daemonset-2q5pm\" (UID: \"66b99e2b-9334-4078-8814-8866b6667387\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:21.704943 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.704901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66b99e2b-9334-4078-8814-8866b6667387-lib-modules\") pod \"perf-node-gather-daemonset-2q5pm\" (UID: \"66b99e2b-9334-4078-8814-8866b6667387\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:21.705284 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.705261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66b99e2b-9334-4078-8814-8866b6667387-sys\") pod \"perf-node-gather-daemonset-2q5pm\" (UID: \"66b99e2b-9334-4078-8814-8866b6667387\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:21.705510 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.705477 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66b99e2b-9334-4078-8814-8866b6667387-proc\") pod \"perf-node-gather-daemonset-2q5pm\" (UID: \"66b99e2b-9334-4078-8814-8866b6667387\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:21.705658 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.705642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6srb\" (UniqueName: \"kubernetes.io/projected/66b99e2b-9334-4078-8814-8866b6667387-kube-api-access-g6srb\") pod \"perf-node-gather-daemonset-2q5pm\" (UID: \"66b99e2b-9334-4078-8814-8866b6667387\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:21.705809 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.705793 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66b99e2b-9334-4078-8814-8866b6667387-podres\") pod \"perf-node-gather-daemonset-2q5pm\" (UID: \"66b99e2b-9334-4078-8814-8866b6667387\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:21.706125 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.706107 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66b99e2b-9334-4078-8814-8866b6667387-podres\") pod \"perf-node-gather-daemonset-2q5pm\" (UID: \"66b99e2b-9334-4078-8814-8866b6667387\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:21.706239 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.706217 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66b99e2b-9334-4078-8814-8866b6667387-sys\") pod \"perf-node-gather-daemonset-2q5pm\" (UID: \"66b99e2b-9334-4078-8814-8866b6667387\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:21.706331 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.706257 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66b99e2b-9334-4078-8814-8866b6667387-proc\") pod \"perf-node-gather-daemonset-2q5pm\" (UID: \"66b99e2b-9334-4078-8814-8866b6667387\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:21.706331 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.706297 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66b99e2b-9334-4078-8814-8866b6667387-lib-modules\") pod \"perf-node-gather-daemonset-2q5pm\" (UID: \"66b99e2b-9334-4078-8814-8866b6667387\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:21.717011 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.716979 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6srb\" (UniqueName: \"kubernetes.io/projected/66b99e2b-9334-4078-8814-8866b6667387-kube-api-access-g6srb\") pod \"perf-node-gather-daemonset-2q5pm\" (UID: \"66b99e2b-9334-4078-8814-8866b6667387\") " pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:21.884467 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.884361 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:21.981651 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.981616 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/1.log" Jul 06 21:40:21.989348 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:21.989319 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z8vzb_a3f837b9-6181-468c-a74e-70d104adfdae/console-operator/2.log" Jul 06 21:40:22.074593 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:22.072906 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm"] Jul 06 21:40:22.591421 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:22.591388 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" event={"ID":"66b99e2b-9334-4078-8814-8866b6667387","Type":"ContainerStarted","Data":"e1bd19eca07959ef933840b0cd6b256dc3ab9d410140f86e408b4502bd645eab"} Jul 06 21:40:22.591841 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:22.591439 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" event={"ID":"66b99e2b-9334-4078-8814-8866b6667387","Type":"ContainerStarted","Data":"5c171540e21f395d7c1d5b8c10db82c2819de33045afa394608cbf759438ae91"} Jul 06 21:40:22.591841 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:22.591469 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:23.186677 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:23.186637 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-s7bvx_ecb7d917-0d0b-47a6-8756-d579096a6c11/volume-data-source-validator/0.log" Jul 06 21:40:24.302748 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:24.302709 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6r4bb_ba87842f-c445-41bd-9656-bc4a83369b6b/dns/0.log" Jul 06 21:40:24.352229 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:24.352200 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6r4bb_ba87842f-c445-41bd-9656-bc4a83369b6b/kube-rbac-proxy/0.log" Jul 06 21:40:24.649262 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:24.649184 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cf2gt_0baf1d79-4121-4204-930a-08a0ada71541/dns-node-resolver/0.log" Jul 06 21:40:25.457309 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:25.457272 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-knjjg_a933fdae-34bf-47b1-a811-908317f0df93/node-ca/0.log" Jul 06 21:40:26.705956 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:26.705922 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686455847d-lm59s_5881c4aa-faa0-4d05-b904-bbdf564bd48c/kube-auth-proxy/0.log" Jul 06 21:40:27.039608 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:27.039576 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7df99b5f7c-g9r85_a1772b59-30ba-434b-b201-19ab05b7f824/router/0.log" Jul 06 21:40:27.822948 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:27.822906 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rqt9r_3af73baf-4a83-4153-9a73-9b9b6674fc09/serve-healthcheck-canary/0.log" Jul 06 21:40:28.396280 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:28.396216 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-592fg_16ffece4-6447-47d6-a16d-aafe0117f6e9/insights-operator/0.log" Jul 06 21:40:28.397210 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:28.397177 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-592fg_16ffece4-6447-47d6-a16d-aafe0117f6e9/insights-operator/1.log" Jul 06 21:40:28.526797 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:28.526769 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wt5zj_1b83685a-6ba3-4f56-bc18-9d5818ca8af5/kube-rbac-proxy/0.log" Jul 06 21:40:28.557567 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:28.557542 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wt5zj_1b83685a-6ba3-4f56-bc18-9d5818ca8af5/exporter/0.log" Jul 06 21:40:28.587377 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:28.587349 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wt5zj_1b83685a-6ba3-4f56-bc18-9d5818ca8af5/extractor/0.log" Jul 06 21:40:28.609346 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:28.609310 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" Jul 06 21:40:28.629979 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:28.629914 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-64qs2/perf-node-gather-daemonset-2q5pm" podStartSLOduration=7.629895071 podStartE2EDuration="7.629895071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:40:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:40:22.61202507 +0000 UTC m=+2518.140872870" watchObservedRunningTime="2026-07-06 21:40:28.629895071 +0000 UTC m=+2524.158742871" Jul 06 21:40:31.832880 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:31.832852 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bd9f97986-gc8w4_64383df9-e442-470c-b813-92a765e3d99a/manager/0.log" Jul 06 21:40:31.860224 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:31.860145 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bd9f97986-gc8w4_64383df9-e442-470c-b813-92a765e3d99a/copy-manifests/0.log" Jul 06 21:40:32.490259 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:32.490217 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686455847d-lm59s_5881c4aa-faa0-4d05-b904-bbdf564bd48c/kube-auth-proxy/0.log" Jul 06 21:40:32.714056 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:32.714013 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7df99b5f7c-g9r85_a1772b59-30ba-434b-b201-19ab05b7f824/router/0.log" Jul 06 21:40:33.411876 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:33.411848 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6cfbcfb449-jhnm2_466ad7c2-fbbe-44bc-853f-ea2a8da9a7a6/manager/0.log" Jul 06 21:40:34.093174 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:34.093144 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686455847d-lm59s_5881c4aa-faa0-4d05-b904-bbdf564bd48c/kube-auth-proxy/0.log" Jul 06 21:40:34.312952 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:34.312925 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7df99b5f7c-g9r85_a1772b59-30ba-434b-b201-19ab05b7f824/router/0.log" Jul 06 21:40:38.943439 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:38.943355 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-xvqtl_79b1e6af-13f8-4946-ae15-78db17d10d04/kube-storage-version-migrator-operator/1.log" Jul 06 21:40:38.944431 ip-10-0-131-226 kubenswrapper[2564]: I0706 21:40:38.944414 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-xvqtl_79b1e6af-13f8-4946-ae15-78db17d10d04/kube-storage-version-migrator-operator/0.log"