Jul 09 13:56:15.573993 ip-10-0-136-155 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 13:56:15.574003 ip-10-0-136-155 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 13:56:15.574010 ip-10-0-136-155 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 13:56:15.574219 ip-10-0-136-155 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 13:56:26.825256 ip-10-0-136-155 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 13:56:26.825271 ip-10-0-136-155 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 765148c92dab4ef3a9b217e3c313eb28 -- Jul 09 13:58:20.711946 ip-10-0-136-155 systemd[1]: Starting Kubernetes Kubelet... Jul 09 13:58:21.107373 ip-10-0-136-155 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 13:58:21.107373 ip-10-0-136-155 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 13:58:21.107373 ip-10-0-136-155 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 13:58:21.107373 ip-10-0-136-155 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 13:58:21.107373 ip-10-0-136-155 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 13:58:21.109720 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.109622 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 13:58:21.113894 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113874 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:58:21.113894 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113893 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113897 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113900 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113903 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113906 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113908 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113911 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113915 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113918 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113921 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113923 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113926 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113936 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113940 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113943 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113945 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113948 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113951 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113954 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113957 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:58:21.113966 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113960 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113963 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113965 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113968 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113971 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113973 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113976 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113979 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113982 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113985 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113989 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113991 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113994 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113996 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.113999 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114002 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114004 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114014 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114017 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114019 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:58:21.114431 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114021 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114024 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114026 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114029 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114032 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114034 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114037 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114039 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114041 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114050 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114053 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114055 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114059 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114061 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114064 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114067 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114070 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114072 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114075 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114078 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:58:21.114915 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114080 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114083 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114085 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114088 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114090 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114093 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114095 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114098 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114102 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114105 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114116 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114119 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114121 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114124 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114126 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114129 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114131 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114135 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114140 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:58:21.115384 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114142 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114145 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114147 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114150 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114152 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114155 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114158 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114161 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114164 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114166 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114169 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114172 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114174 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114178 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114182 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114186 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114189 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114192 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114194 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:58:21.115847 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114965 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114971 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114975 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114977 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114981 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114985 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114988 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114991 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114993 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114996 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.114998 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115001 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115004 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115006 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115009 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115011 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115014 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115016 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115020 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115023 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:58:21.116299 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115027 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115029 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115032 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115034 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115037 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115039 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115042 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115044 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115047 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115049 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115052 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115054 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115057 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115059 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115062 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115064 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115067 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115069 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115072 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115075 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:58:21.116805 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115077 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115080 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115082 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115085 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115088 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115090 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115094 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115096 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115100 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115104 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115110 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115113 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115117 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115120 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115123 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115126 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115129 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115132 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115135 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:58:21.117282 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115137 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115140 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115143 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115146 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115148 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115151 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115154 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115157 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115160 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115163 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115165 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115168 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115171 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115173 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115176 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115178 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115181 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115184 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115187 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115190 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:58:21.117770 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115192 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115195 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115198 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115200 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115202 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115205 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115208 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115211 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115213 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115216 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115218 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115221 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115224 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115226 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115229 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115231 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115234 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115236 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115251 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115254 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:58:21.118244 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115682 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115689 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115692 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115694 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115698 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115701 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115704 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115707 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115710 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115713 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115715 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115718 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115720 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115723 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115726 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115728 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115731 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115734 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115736 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115739 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:58:21.118745 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115741 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115744 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115747 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115749 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115752 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115754 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115757 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115759 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115762 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115765 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115767 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115772 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115775 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115777 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115780 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115782 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115784 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115788 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115791 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115793 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:58:21.119220 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115796 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115798 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115801 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115803 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115806 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115809 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115811 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115814 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115817 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115819 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115822 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115825 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115827 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115830 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115832 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115835 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115837 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115839 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115842 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:58:21.119710 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115844 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115850 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115853 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115857 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115861 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115865 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115867 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115870 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115872 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115875 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115877 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115880 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115883 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115885 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115888 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115890 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115893 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115895 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115899 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115902 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:58:21.120197 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115905 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115909 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115912 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115916 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115920 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115923 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115925 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115928 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115931 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115934 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115937 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115940 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115942 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115945 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115948 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115951 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115955 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115957 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115960 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:58:21.120723 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.115962 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116042 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116050 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116059 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116063 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116068 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116071 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116075 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116080 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116083 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116086 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116091 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116094 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116097 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116100 2565 flags.go:64] FLAG: --cgroup-root="" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116103 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116106 2565 flags.go:64] FLAG: --client-ca-file="" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116109 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116112 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116117 2565 flags.go:64] FLAG: --cluster-domain="" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116120 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116123 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116126 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116130 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 13:58:21.121207 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116134 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116137 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116140 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116143 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116146 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116150 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116153 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116156 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116159 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116164 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116167 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116170 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116173 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116176 2565 flags.go:64] FLAG: --enable-server="true" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116179 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116184 2565 flags.go:64] FLAG: --event-burst="100" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116187 2565 flags.go:64] FLAG: --event-qps="50" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116190 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116193 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116198 2565 flags.go:64] FLAG: --eviction-hard="" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116202 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116204 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116207 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116210 2565 flags.go:64] FLAG: --eviction-soft="" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116213 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 13:58:21.121827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116216 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116219 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116222 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116225 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116228 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116230 2565 flags.go:64] FLAG: --feature-gates="" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116235 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116238 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116241 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116244 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116247 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116250 2565 flags.go:64] FLAG: --help="false" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116254 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-136-155.ec2.internal" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116257 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116260 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116263 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116266 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116270 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116273 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116276 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116279 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116282 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116286 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116289 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 13:58:21.122427 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116292 2565 flags.go:64] FLAG: --kube-reserved="" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116295 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116299 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116302 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116305 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116308 2565 flags.go:64] FLAG: --lock-file="" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116311 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116314 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116317 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116322 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116325 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116328 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116331 2565 flags.go:64] FLAG: --logging-format="text" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116334 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116337 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116340 2565 flags.go:64] FLAG: --manifest-url="" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116344 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116348 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116351 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116355 2565 flags.go:64] FLAG: --max-pods="110" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116360 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116363 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116365 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116368 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116372 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 13:58:21.123078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116374 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116377 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116385 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116388 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116391 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116395 2565 flags.go:64] FLAG: --pod-cidr="" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116398 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116404 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116407 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116410 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116415 2565 flags.go:64] FLAG: --port="10250" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116418 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116421 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0553355657c937bd1" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116424 2565 flags.go:64] FLAG: --qos-reserved="" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116427 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116430 2565 flags.go:64] FLAG: --register-node="true" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116433 2565 flags.go:64] FLAG: --register-with-taints="" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116436 2565 flags.go:64] FLAG: --registry-burst="10" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116439 2565 flags.go:64] FLAG: --registry-qps="5" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116442 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116445 2565 flags.go:64] FLAG: --reserved-memory="" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116458 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116462 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116465 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116468 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 13:58:21.124173 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116472 2565 flags.go:64] FLAG: --runonce="false" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116475 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116480 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116483 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116485 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116488 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116491 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116494 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116497 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116500 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116503 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116506 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116509 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116512 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116516 2565 flags.go:64] FLAG: --system-cgroups="" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116519 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116524 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116528 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116531 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116535 2565 flags.go:64] FLAG: --tls-min-version="" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116538 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116541 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116544 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116546 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116549 2565 flags.go:64] FLAG: --v="2" Jul 09 13:58:21.125270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116553 2565 flags.go:64] FLAG: --version="false" Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116557 2565 flags.go:64] FLAG: --vmodule="" Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116562 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.116565 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116699 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116704 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116707 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116710 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116713 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116720 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116723 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116726 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116728 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116731 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116733 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116736 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116738 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116741 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116743 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116746 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:58:21.126409 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116748 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116751 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116754 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116757 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116761 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116764 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116767 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116769 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116772 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116774 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116777 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116780 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116782 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116785 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116788 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116790 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116792 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116795 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116797 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116800 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:58:21.127373 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116802 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116806 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116809 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116811 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116814 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116817 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116820 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116822 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116825 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116828 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116831 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116835 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116838 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116840 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116843 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116846 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116850 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116854 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116856 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116859 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:58:21.128150 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116862 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116864 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116868 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116871 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116873 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116876 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116878 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116881 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116883 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116886 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116888 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116891 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116893 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116897 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116900 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116902 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116904 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116907 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116909 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:58:21.128676 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116912 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116914 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116917 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116919 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116923 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116926 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116929 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116932 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116935 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116939 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116943 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116945 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116948 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116950 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116953 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116955 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116958 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116960 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116963 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:58:21.129137 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116965 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:58:21.129604 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116968 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:58:21.129604 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116970 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:58:21.129604 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116973 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:58:21.129604 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.116975 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:58:21.129604 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.117775 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 13:58:21.129604 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.125570 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 13:58:21.129604 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.125591 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 13:58:21.129604 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.125620 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 13:58:21.129604 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.125628 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 13:58:21.129604 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125728 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:58:21.129604 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125739 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:58:21.129604 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125746 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:58:21.129604 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125751 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:58:21.129604 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125755 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125760 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125764 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125768 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125773 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125777 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125782 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125786 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125790 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125795 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125799 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125803 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125807 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125811 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125816 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125820 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125825 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125829 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125833 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125837 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:58:21.130029 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125841 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125846 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125850 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125854 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125858 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125865 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125869 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125874 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125878 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125882 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125886 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125891 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125895 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125899 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125902 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125907 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125911 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125916 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125920 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125924 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:58:21.130511 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125928 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125932 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125936 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125940 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125944 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125950 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125957 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125962 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125966 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125971 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125975 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125979 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125983 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125987 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125991 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.125996 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126001 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126006 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126012 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126016 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:58:21.131010 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126020 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126024 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126028 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126033 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126037 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126042 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126046 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126050 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126057 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126062 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126066 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126071 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126075 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126080 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126084 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126088 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126092 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126097 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126101 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:58:21.131490 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126105 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:58:21.131958 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126109 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:58:21.131958 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126113 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:58:21.131958 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126117 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:58:21.131958 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126121 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:58:21.131958 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126126 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:58:21.131958 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126130 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:58:21.131958 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126134 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:58:21.131958 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126138 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:58:21.131958 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126143 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:58:21.131958 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126148 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:58:21.131958 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126152 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:58:21.131958 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126156 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:58:21.131958 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126161 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:58:21.131958 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126165 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:58:21.131958 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126169 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:58:21.132320 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.126177 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 13:58:21.132320 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126352 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:58:21.132320 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126361 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:58:21.132320 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126365 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:58:21.132320 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126370 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:58:21.132320 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126374 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:58:21.132320 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126378 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:58:21.132320 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126382 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:58:21.132320 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126386 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:58:21.132320 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126390 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:58:21.132320 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126394 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:58:21.132320 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126398 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:58:21.132320 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126403 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:58:21.132320 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126407 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:58:21.132320 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126411 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126414 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126418 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126422 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126426 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126430 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126434 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126437 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126441 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126446 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126450 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126455 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126460 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126464 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126468 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126473 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126478 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126482 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126485 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126490 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:58:21.132725 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126494 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126498 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126502 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126506 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126511 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126515 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126519 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126523 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126527 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126531 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126535 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126539 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126543 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126547 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126551 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126555 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126559 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126563 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126567 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126571 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:58:21.133214 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126576 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126581 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126585 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126590 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126595 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126599 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126603 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126606 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126612 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126618 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126622 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126626 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126630 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126634 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126639 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126660 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126667 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126672 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126675 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:58:21.133776 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126680 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126684 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126688 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126692 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126696 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126700 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126703 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126707 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126711 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126714 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126718 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126722 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126725 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126729 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126733 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126736 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126740 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126744 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126748 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126752 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:58:21.134230 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126756 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:58:21.134716 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126760 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:58:21.134716 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126766 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:58:21.134716 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126771 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:58:21.134716 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126775 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:58:21.134716 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126779 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:58:21.134716 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:21.126783 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:58:21.134716 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.126791 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 13:58:21.134716 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.127661 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 13:58:21.134716 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.129919 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 13:58:21.134716 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.131268 2565 server.go:1019] "Starting client certificate rotation" Jul 09 13:58:21.134716 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.131364 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 13:58:21.134716 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.131404 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 13:58:21.135021 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.133958 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 13:58:21.135190 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.135170 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 13:58:21.142984 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.142965 2565 log.go:25] "Validated CRI v1 runtime API" Jul 09 13:58:21.146920 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.146903 2565 log.go:25] "Validated CRI v1 image API" Jul 09 13:58:21.147714 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.147700 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 13:58:21.149862 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.149842 2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ec886516-4f8f-46da-9132-666f79d42d34:/dev/nvme0n1p4 f1634d48-6fd3-44c5-a383-26ddb1dade74:/dev/nvme0n1p3] Jul 09 13:58:21.149916 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.149862 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 13:58:21.155618 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.155501 2565 manager.go:216] Machine: {Timestamp:2026-07-09 13:58:21.15348615 +0000 UTC m=+0.330173433 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099981 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e89ef89bc2f9cd324364e74777069 SystemUUID:ec2e89ef-89bc-2f9c-d324-364e74777069 BootID:765148c9-2dab-4ef3-a9b2-17e3c313eb28 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cc:c5:a1:87:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cc:c5:a1:87:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:02:b3:2a:c6:93 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 13:58:21.155618 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.155613 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 13:58:21.155770 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.155720 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 13:58:21.158298 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.158280 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 13:58:21.158436 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.158406 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 13:58:21.158620 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.158440 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-155.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 13:58:21.159107 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.159097 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 13:58:21.159151 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.159110 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 13:58:21.159151 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.159118 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 13:58:21.159826 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.159815 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 13:58:21.161025 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.161016 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 13:58:21.163761 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.163749 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 09 13:58:21.163881 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.163872 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 13:58:21.163919 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.163901 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 09 13:58:21.163919 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.163914 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 13:58:21.163974 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.163940 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 13:58:21.163974 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.163952 2565 kubelet.go:398] "Adding apiserver pod source" Jul 09 13:58:21.163974 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.163961 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 13:58:21.164364 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.164344 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 13:58:21.164425 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.164381 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 13:58:21.167117 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.167092 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 13:58:21.168884 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.168869 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 13:58:21.168941 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.168900 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 13:58:21.169055 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.169045 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 13:58:21.169107 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.169059 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 13:58:21.169107 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.169065 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 13:58:21.169107 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.169071 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 13:58:21.169107 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.169079 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 13:58:21.169107 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.169085 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 13:58:21.169598 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.169589 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 13:58:21.169633 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.169599 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 13:58:21.169633 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.169607 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 13:58:21.169633 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.169612 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 13:58:21.169633 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.169621 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 13:58:21.169633 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.169628 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 13:58:21.170448 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.170439 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 13:58:21.170448 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.170447 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 13:58:21.173531 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.173518 2565 server.go:1268] "Started kubelet" Jul 09 13:58:21.173740 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.173630 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 13:58:21.173810 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.173752 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 13:58:21.173810 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.173783 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 13:58:21.174527 ip-10-0-136-155 systemd[1]: Started Kubernetes Kubelet. Jul 09 13:58:21.174865 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.174844 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 13:58:21.175294 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.175276 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-155.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 13:58:21.175372 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.175336 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 13:58:21.175789 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.175726 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-155.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 13:58:21.176358 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.176343 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 09 13:58:21.179176 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.179153 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 13:58:21.181322 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.180298 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-155.ec2.internal.18c0a3c0dce0e910 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-155.ec2.internal,UID:ip-10-0-136-155.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-155.ec2.internal,},FirstTimestamp:2026-07-09 13:58:21.173491984 +0000 UTC m=+0.350179267,LastTimestamp:2026-07-09 13:58:21.173491984 +0000 UTC m=+0.350179267,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-155.ec2.internal,}" Jul 09 13:58:21.184590 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.184576 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qbs2d" Jul 09 13:58:21.185127 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.184915 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 13:58:21.185127 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.184931 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 13:58:21.185127 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.185078 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:58:21.185713 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.185698 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 13:58:21.185848 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.185816 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 13:58:21.185848 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.185700 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 13:58:21.185984 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.185920 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 09 13:58:21.185984 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.185928 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 09 13:58:21.185984 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.185946 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 13:58:21.185984 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.185961 2565 factory.go:55] Registering systemd factory Jul 09 13:58:21.185984 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.185971 2565 factory.go:223] Registration of the systemd container factory successfully Jul 09 13:58:21.186214 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.186192 2565 factory.go:153] Registering CRI-O factory Jul 09 13:58:21.186214 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.186205 2565 factory.go:223] Registration of the crio container factory successfully Jul 09 13:58:21.186295 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.186227 2565 factory.go:103] Registering Raw factory Jul 09 13:58:21.186295 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.186243 2565 manager.go:1196] Started watching for new ooms in manager Jul 09 13:58:21.186796 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.186783 2565 manager.go:349] Starting recovery of all containers Jul 09 13:58:21.186991 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.186968 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-155.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 13:58:21.187333 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.187306 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 13:58:21.194028 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.193323 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qbs2d" Jul 09 13:58:21.197063 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.197042 2565 manager.go:354] Recovery completed Jul 09 13:58:21.201949 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.201935 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:58:21.203712 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.203697 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:58:21.203775 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.203726 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:58:21.203775 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.203736 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:58:21.204355 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.204342 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 13:58:21.204355 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.204354 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 13:58:21.204430 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.204369 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 09 13:58:21.204467 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.204346 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:58:21.205068 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.205055 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:58:21.205124 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.205080 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:58:21.205124 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.205089 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:58:21.205412 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.205402 2565 policy_none.go:49] "None policy: Start" Jul 09 13:58:21.205446 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.205419 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 13:58:21.205446 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.205432 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 13:58:21.206337 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.206327 2565 policy_none.go:47] "Start" Jul 09 13:58:21.248547 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.248526 2565 manager.go:337] "Starting Device Plugin manager" Jul 09 13:58:21.248703 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.248572 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 13:58:21.248703 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.248586 2565 server.go:87] "Starting device plugin registration server" Jul 09 13:58:21.248926 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.248912 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 13:58:21.248994 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.248931 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 13:58:21.249043 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.249000 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 13:58:21.249170 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.249106 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 13:58:21.249170 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.249120 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 13:58:21.249756 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.249729 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 13:58:21.249849 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.249786 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:58:21.343690 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.343643 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 13:58:21.344972 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.344958 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 13:58:21.345036 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.344995 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 13:58:21.345036 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.345018 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 13:58:21.345131 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.345055 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 13:58:21.348001 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.347977 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:58:21.349964 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.349950 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:58:21.351102 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.351087 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:58:21.351180 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.351118 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:58:21.351180 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.351132 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:58:21.351180 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.351160 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-155.ec2.internal" Jul 09 13:58:21.362407 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.362355 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-155.ec2.internal" Jul 09 13:58:21.362407 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.362381 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-155.ec2.internal\": node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:58:21.381851 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.381821 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:58:21.445155 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.445100 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal"] Jul 09 13:58:21.445325 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.445195 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:58:21.447319 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.447299 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:58:21.447424 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.447339 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:58:21.447424 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.447356 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:58:21.448896 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.448879 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:58:21.449033 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.449018 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 09 13:58:21.449080 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.449049 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:58:21.450484 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.450467 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:58:21.450581 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.450500 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:58:21.450581 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.450514 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:58:21.450581 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.450474 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:58:21.450581 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.450579 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:58:21.450795 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.450591 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:58:21.451863 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.451849 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" Jul 09 13:58:21.451920 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.451875 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:58:21.452707 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.452693 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:58:21.452795 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.452723 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:58:21.452795 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.452759 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:58:21.467315 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.467294 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-155.ec2.internal\" not found" node="ip-10-0-136-155.ec2.internal" Jul 09 13:58:21.472123 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.472107 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-155.ec2.internal\" not found" node="ip-10-0-136-155.ec2.internal" Jul 09 13:58:21.482568 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.482548 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:58:21.488373 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.488347 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f671eeaf614c8d693fab4bd5bb741bfd-config\") pod \"kube-apiserver-proxy-ip-10-0-136-155.ec2.internal\" (UID: \"f671eeaf614c8d693fab4bd5bb741bfd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" Jul 09 13:58:21.488429 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.488383 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27d6497d34fdf915d7c702237be63dc6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal\" (UID: \"27d6497d34fdf915d7c702237be63dc6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 09 13:58:21.488429 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.488413 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27d6497d34fdf915d7c702237be63dc6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal\" (UID: \"27d6497d34fdf915d7c702237be63dc6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 09 13:58:21.583318 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.583287 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:58:21.589175 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.589151 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f671eeaf614c8d693fab4bd5bb741bfd-config\") pod \"kube-apiserver-proxy-ip-10-0-136-155.ec2.internal\" (UID: \"f671eeaf614c8d693fab4bd5bb741bfd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" Jul 09 13:58:21.589237 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.589189 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27d6497d34fdf915d7c702237be63dc6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal\" (UID: \"27d6497d34fdf915d7c702237be63dc6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 09 13:58:21.589237 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.589209 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27d6497d34fdf915d7c702237be63dc6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal\" (UID: \"27d6497d34fdf915d7c702237be63dc6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 09 13:58:21.589237 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.589231 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27d6497d34fdf915d7c702237be63dc6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal\" (UID: \"27d6497d34fdf915d7c702237be63dc6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 09 13:58:21.589354 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.589161 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f671eeaf614c8d693fab4bd5bb741bfd-config\") pod \"kube-apiserver-proxy-ip-10-0-136-155.ec2.internal\" (UID: \"f671eeaf614c8d693fab4bd5bb741bfd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" Jul 09 13:58:21.589354 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.589304 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27d6497d34fdf915d7c702237be63dc6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal\" (UID: \"27d6497d34fdf915d7c702237be63dc6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 09 13:58:21.684156 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.684065 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:58:21.775600 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.775557 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" Jul 09 13:58:21.775600 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:21.775599 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 09 13:58:21.784987 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.784962 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:58:21.887483 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.887441 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:58:21.987904 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:21.987809 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:58:22.088576 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:22.088540 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:58:22.131127 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:22.131095 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 13:58:22.131728 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:22.131263 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 13:58:22.189765 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:22.189739 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:58:22.198980 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:22.198949 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 13:53:21 +0000 UTC" deadline="2028-03-01 18:05:54.821533601 +0000 UTC" Jul 09 13:58:22.198980 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:22.198976 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14428h7m32.622560119s" Jul 09 13:58:22.285582 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:22.285551 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:58:22.290849 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:22.290827 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:58:22.391033 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:22.390992 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:58:22.409608 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:22.409573 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d6497d34fdf915d7c702237be63dc6.slice/crio-f8328451724783b9afa6ecf4b250c4ec89ebf9b9dea0d8628dcb2b82311ec701 WatchSource:0}: Error finding container f8328451724783b9afa6ecf4b250c4ec89ebf9b9dea0d8628dcb2b82311ec701: Status 404 returned error can't find the container with id f8328451724783b9afa6ecf4b250c4ec89ebf9b9dea0d8628dcb2b82311ec701 Jul 09 13:58:22.410306 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:22.410285 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf671eeaf614c8d693fab4bd5bb741bfd.slice/crio-47fa05a1616cd64834d61b23a45d1670046ff7495a4e11c618cbaeb499a5ecd7 WatchSource:0}: Error finding container 47fa05a1616cd64834d61b23a45d1670046ff7495a4e11c618cbaeb499a5ecd7: Status 404 returned error can't find the container with id 47fa05a1616cd64834d61b23a45d1670046ff7495a4e11c618cbaeb499a5ecd7 Jul 09 13:58:22.414854 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:22.414825 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 13:58:22.491207 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:22.491167 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:58:22.592037 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:22.591947 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:58:22.621676 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:22.621642 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:58:22.692391 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:22.692337 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-155.ec2.internal\" not found" Jul 09 13:58:22.728428 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:22.728372 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:58:22.786128 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:22.786086 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" Jul 09 13:58:22.798266 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:22.798242 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 13:58:22.799226 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:22.799212 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" Jul 09 13:58:22.807397 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:22.807373 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 13:58:23.166135 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.166095 2565 apiserver.go:52] "Watching apiserver" Jul 09 13:58:23.177976 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.177938 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 13:58:23.179115 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.179088 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal","openshift-image-registry/node-ca-m6jmd","openshift-network-diagnostics/network-check-target-hnkjm","openshift-network-operator/iptables-alerter-d5mzs","openshift-ovn-kubernetes/ovnkube-node-msflv","kube-system/global-pull-secret-syncer-tsfdc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69","openshift-cluster-node-tuning-operator/tuned-p2zgn","openshift-dns/node-resolver-nq5wm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal","openshift-multus/multus-additional-cni-plugins-jbdq5","openshift-multus/multus-xgq5t","openshift-multus/network-metrics-daemon-q7c98","kube-system/konnectivity-agent-6b4n4"] Jul 09 13:58:23.181851 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.181828 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.184386 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.184333 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:23.184499 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.184425 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7c98" podUID="8ac5555e-e619-4a4f-974a-3597a9455f44" Jul 09 13:58:23.185183 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.184821 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 13:58:23.185183 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.184834 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 13:58:23.185183 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.184828 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 13:58:23.185183 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.185006 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-27n56\"" Jul 09 13:58:23.187221 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.187189 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 13:58:23.187682 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.187655 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:23.187848 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.187812 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnkjm" podUID="899ea887-23f2-4698-8a03-ebcc2f90c392" Jul 09 13:58:23.189174 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.189153 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d5mzs" Jul 09 13:58:23.193059 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.191711 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:58:23.193059 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.192158 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 13:58:23.193059 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.192416 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4jkf6\"" Jul 09 13:58:23.193059 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.192573 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 13:58:23.193059 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.192621 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.194424 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.194229 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:23.194424 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.194294 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsfdc" podUID="e88b57b8-05d6-4e3f-9a01-07c5a05a31ee" Jul 09 13:58:23.195375 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.195349 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 13:58:23.196144 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.196118 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 13:58:23.196254 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.196215 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 13:58:23.196447 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.196429 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 13:58:23.196447 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.196442 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 13:58:23.196606 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.196579 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pcmzz\"" Jul 09 13:58:23.196883 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.196862 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 13:58:23.197826 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.197808 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nq5wm" Jul 09 13:58:23.198167 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.198143 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c4c04533-d231-4114-94ac-9cd50a96f6e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.198252 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.198211 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c4c04533-d231-4114-94ac-9cd50a96f6e9-registration-dir\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.198252 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.198245 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs\") pod \"network-metrics-daemon-q7c98\" (UID: \"8ac5555e-e619-4a4f-974a-3597a9455f44\") " pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:23.198358 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.198271 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb68389e-de3f-4b1a-ba44-e7bedb7c540f-host-slash\") pod \"iptables-alerter-d5mzs\" (UID: \"eb68389e-de3f-4b1a-ba44-e7bedb7c540f\") " pod="openshift-network-operator/iptables-alerter-d5mzs" Jul 09 13:58:23.198358 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.198299 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c4c04533-d231-4114-94ac-9cd50a96f6e9-socket-dir\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.198358 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.198326 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zrfr\" (UniqueName: \"kubernetes.io/projected/c4c04533-d231-4114-94ac-9cd50a96f6e9-kube-api-access-8zrfr\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.198512 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.198355 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46sq9\" (UniqueName: \"kubernetes.io/projected/8ac5555e-e619-4a4f-974a-3597a9455f44-kube-api-access-46sq9\") pod \"network-metrics-daemon-q7c98\" (UID: \"8ac5555e-e619-4a4f-974a-3597a9455f44\") " pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:23.198512 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.198381 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-458pl\" (UniqueName: \"kubernetes.io/projected/eb68389e-de3f-4b1a-ba44-e7bedb7c540f-kube-api-access-458pl\") pod \"iptables-alerter-d5mzs\" (UID: \"eb68389e-de3f-4b1a-ba44-e7bedb7c540f\") " pod="openshift-network-operator/iptables-alerter-d5mzs" Jul 09 13:58:23.198512 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.198407 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c4c04533-d231-4114-94ac-9cd50a96f6e9-sys-fs\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.198512 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.198432 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhrmd\" (UniqueName: \"kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd\") pod \"network-check-target-hnkjm\" (UID: \"899ea887-23f2-4698-8a03-ebcc2f90c392\") " pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:23.198512 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.198459 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eb68389e-de3f-4b1a-ba44-e7bedb7c540f-iptables-alerter-script\") pod \"iptables-alerter-d5mzs\" (UID: \"eb68389e-de3f-4b1a-ba44-e7bedb7c540f\") " pod="openshift-network-operator/iptables-alerter-d5mzs" Jul 09 13:58:23.198512 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.198497 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c4c04533-d231-4114-94ac-9cd50a96f6e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.198810 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.198528 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c4c04533-d231-4114-94ac-9cd50a96f6e9-device-dir\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.199306 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.199283 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 13:58:23.199859 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.199814 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6b4n4" Jul 09 13:58:23.200457 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.200436 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 13:58:23.200546 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.200457 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zpwdq\"" Jul 09 13:58:23.200760 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.200744 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 13:58:23.202504 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.202484 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6fc9n\"" Jul 09 13:58:23.202789 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.202769 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 13:58:23.202887 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.202770 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 13:58:23.203128 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.203111 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m6jmd" Jul 09 13:58:23.206053 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.206028 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.207048 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.207022 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 13:58:23.207270 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.207249 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 13:58:23.208590 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.207615 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nw8wd\"" Jul 09 13:58:23.208684 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.208626 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:58:23.209609 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.209059 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 13:58:23.209609 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.209338 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-flkmt\"" Jul 09 13:58:23.211182 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.209951 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.211182 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.209981 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 13:58:23.214138 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.214116 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 13:58:23.214248 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.214218 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 13:58:23.214389 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.214370 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 13:58:23.214508 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.214128 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k7tnw\"" Jul 09 13:58:23.214596 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.214516 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 13:58:23.214596 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.214574 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 13:58:23.217089 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.217072 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.219383 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.219357 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 13:58:23.219740 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.219714 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xxbvb\"" Jul 09 13:58:23.221521 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.221499 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wh9pv" Jul 09 13:58:23.232666 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.232639 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wh9pv" Jul 09 13:58:23.286873 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.286849 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 13:58:23.298749 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.298713 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dffk\" (UniqueName: \"kubernetes.io/projected/cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55-kube-api-access-6dffk\") pod \"node-ca-m6jmd\" (UID: \"cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55\") " pod="openshift-image-registry/node-ca-m6jmd" Jul 09 13:58:23.298905 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.298761 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-etc-modprobe-d\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.298905 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.298793 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-system-cni-dir\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.298905 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.298816 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6368ef5c-3229-4983-8799-36ea627d4ee2-cni-binary-copy\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.298905 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.298841 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-run-openvswitch\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.298905 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.298867 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-sys\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.298905 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.298893 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-var-lib-openvswitch\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.299221 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.298932 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-run-ovn\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.299221 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.298971 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvkbk\" (UniqueName: \"kubernetes.io/projected/8934e636-88e3-45a1-abbc-f86ce7972aaa-kube-api-access-zvkbk\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.299221 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.299032 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eb68389e-de3f-4b1a-ba44-e7bedb7c540f-iptables-alerter-script\") pod \"iptables-alerter-d5mzs\" (UID: \"eb68389e-de3f-4b1a-ba44-e7bedb7c540f\") " pod="openshift-network-operator/iptables-alerter-d5mzs" Jul 09 13:58:23.299609 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.299585 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c4c04533-d231-4114-94ac-9cd50a96f6e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.299741 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.299635 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-multus-socket-dir-parent\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.299741 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.299651 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eb68389e-de3f-4b1a-ba44-e7bedb7c540f-iptables-alerter-script\") pod \"iptables-alerter-d5mzs\" (UID: \"eb68389e-de3f-4b1a-ba44-e7bedb7c540f\") " pod="openshift-network-operator/iptables-alerter-d5mzs" Jul 09 13:58:23.299741 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.299710 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/549e0930-0906-4ecd-9d31-4b6cd6a38d96-agent-certs\") pod \"konnectivity-agent-6b4n4\" (UID: \"549e0930-0906-4ecd-9d31-4b6cd6a38d96\") " pod="kube-system/konnectivity-agent-6b4n4" Jul 09 13:58:23.299884 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.299773 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c4c04533-d231-4114-94ac-9cd50a96f6e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.299884 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.299814 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8934e636-88e3-45a1-abbc-f86ce7972aaa-ovnkube-config\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.299884 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.299841 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4-hosts-file\") pod \"node-resolver-nq5wm\" (UID: \"f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4\") " pod="openshift-dns/node-resolver-nq5wm" Jul 09 13:58:23.299884 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.299868 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-etc-sysconfig\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.300039 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.299902 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9be55c13-b339-4f55-86d2-4342f11d973c-etc-tuned\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.300039 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.299925 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9be55c13-b339-4f55-86d2-4342f11d973c-tmp\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.300039 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.299960 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31a27df1-dfcb-48d4-aa08-074d2ee3220b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.300039 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.299993 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-run-ovn-kubernetes\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.300039 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300022 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-cni-bin\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.300233 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300060 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c4c04533-d231-4114-94ac-9cd50a96f6e9-socket-dir\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.300233 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300110 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6368ef5c-3229-4983-8799-36ea627d4ee2-multus-daemon-config\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.300233 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300164 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-run-systemd\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.300233 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300198 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-node-log\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.300233 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300224 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c4c04533-d231-4114-94ac-9cd50a96f6e9-sys-fs\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.300500 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300257 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-run\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.300500 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300270 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c4c04533-d231-4114-94ac-9cd50a96f6e9-socket-dir\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.300500 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300312 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c4c04533-d231-4114-94ac-9cd50a96f6e9-sys-fs\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.300500 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300363 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-os-release\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.300500 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300399 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-log-socket\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.300500 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300449 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhrmd\" (UniqueName: \"kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd\") pod \"network-check-target-hnkjm\" (UID: \"899ea887-23f2-4698-8a03-ebcc2f90c392\") " pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:23.300500 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300480 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c4c04533-d231-4114-94ac-9cd50a96f6e9-registration-dir\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.300832 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300504 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55-host\") pod \"node-ca-m6jmd\" (UID: \"cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55\") " pod="openshift-image-registry/node-ca-m6jmd" Jul 09 13:58:23.300832 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300528 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-host-run-k8s-cni-cncf-io\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.300832 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300552 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-host-var-lib-cni-bin\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.300832 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300576 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-multus-conf-dir\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.300832 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300598 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmmrt\" (UniqueName: \"kubernetes.io/projected/6368ef5c-3229-4983-8799-36ea627d4ee2-kube-api-access-kmmrt\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.300832 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300609 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c4c04533-d231-4114-94ac-9cd50a96f6e9-registration-dir\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.300832 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300622 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-etc-sysctl-d\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.300832 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300696 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-etc-kubernetes\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.301159 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300851 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsr4p\" (UniqueName: \"kubernetes.io/projected/9be55c13-b339-4f55-86d2-4342f11d973c-kube-api-access-lsr4p\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.301159 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300883 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4-tmp-dir\") pod \"node-resolver-nq5wm\" (UID: \"f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4\") " pod="openshift-dns/node-resolver-nq5wm" Jul 09 13:58:23.301159 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300907 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-lib-modules\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.301159 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300923 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31a27df1-dfcb-48d4-aa08-074d2ee3220b-cnibin\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.301159 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300939 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-run-netns\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.301159 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.300973 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8934e636-88e3-45a1-abbc-f86ce7972aaa-env-overrides\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.301159 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301022 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-etc-sysctl-conf\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.301159 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301073 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktnsh\" (UniqueName: \"kubernetes.io/projected/31a27df1-dfcb-48d4-aa08-074d2ee3220b-kube-api-access-ktnsh\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.301159 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301104 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-kubelet\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.301159 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301134 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-slash\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.301655 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301169 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-cni-netd\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.301655 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301206 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8934e636-88e3-45a1-abbc-f86ce7972aaa-ovnkube-script-lib\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.301655 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301250 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb68389e-de3f-4b1a-ba44-e7bedb7c540f-host-slash\") pod \"iptables-alerter-d5mzs\" (UID: \"eb68389e-de3f-4b1a-ba44-e7bedb7c540f\") " pod="openshift-network-operator/iptables-alerter-d5mzs" Jul 09 13:58:23.301655 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301330 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55-serviceca\") pod \"node-ca-m6jmd\" (UID: \"cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55\") " pod="openshift-image-registry/node-ca-m6jmd" Jul 09 13:58:23.301655 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301348 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb68389e-de3f-4b1a-ba44-e7bedb7c540f-host-slash\") pod \"iptables-alerter-d5mzs\" (UID: \"eb68389e-de3f-4b1a-ba44-e7bedb7c540f\") " pod="openshift-network-operator/iptables-alerter-d5mzs" Jul 09 13:58:23.301655 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301408 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-host\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.301655 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301456 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.301655 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301482 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-etc-systemd\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.301655 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301512 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zrfr\" (UniqueName: \"kubernetes.io/projected/c4c04533-d231-4114-94ac-9cd50a96f6e9-kube-api-access-8zrfr\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.301655 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301552 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46sq9\" (UniqueName: \"kubernetes.io/projected/8ac5555e-e619-4a4f-974a-3597a9455f44-kube-api-access-46sq9\") pod \"network-metrics-daemon-q7c98\" (UID: \"8ac5555e-e619-4a4f-974a-3597a9455f44\") " pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:23.301655 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301588 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-multus-cni-dir\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.301655 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301615 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-cnibin\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.301655 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301640 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-host-var-lib-kubelet\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.302211 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301687 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-host-run-multus-certs\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.302211 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301715 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/549e0930-0906-4ecd-9d31-4b6cd6a38d96-konnectivity-ca\") pod \"konnectivity-agent-6b4n4\" (UID: \"549e0930-0906-4ecd-9d31-4b6cd6a38d96\") " pod="kube-system/konnectivity-agent-6b4n4" Jul 09 13:58:23.302211 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301739 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4wgn\" (UniqueName: \"kubernetes.io/projected/f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4-kube-api-access-m4wgn\") pod \"node-resolver-nq5wm\" (UID: \"f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4\") " pod="openshift-dns/node-resolver-nq5wm" Jul 09 13:58:23.302211 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301762 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-host-var-lib-cni-multus\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.302211 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301831 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-etc-kubernetes\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.302211 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301863 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-dbus\") pod \"global-pull-secret-syncer-tsfdc\" (UID: \"e88b57b8-05d6-4e3f-9a01-07c5a05a31ee\") " pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:23.302211 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301886 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret\") pod \"global-pull-secret-syncer-tsfdc\" (UID: \"e88b57b8-05d6-4e3f-9a01-07c5a05a31ee\") " pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:23.302211 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301915 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31a27df1-dfcb-48d4-aa08-074d2ee3220b-system-cni-dir\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.302211 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31a27df1-dfcb-48d4-aa08-074d2ee3220b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.302211 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301968 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/31a27df1-dfcb-48d4-aa08-074d2ee3220b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.302211 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.301997 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c4c04533-d231-4114-94ac-9cd50a96f6e9-device-dir\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.302211 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.302023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c4c04533-d231-4114-94ac-9cd50a96f6e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.302211 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.302046 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-hostroot\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.302211 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.302074 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs\") pod \"network-metrics-daemon-q7c98\" (UID: \"8ac5555e-e619-4a4f-974a-3597a9455f44\") " pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:23.302211 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.302099 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-var-lib-kubelet\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.302211 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.302073 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c4c04533-d231-4114-94ac-9cd50a96f6e9-device-dir\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.302902 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.302123 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/31a27df1-dfcb-48d4-aa08-074d2ee3220b-os-release\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.302902 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.302174 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c4c04533-d231-4114-94ac-9cd50a96f6e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.302902 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.302178 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/31a27df1-dfcb-48d4-aa08-074d2ee3220b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.302902 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.302189 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:23.302902 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.302249 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-systemd-units\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.302902 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.302288 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-etc-openvswitch\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.302902 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.302314 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8934e636-88e3-45a1-abbc-f86ce7972aaa-ovn-node-metrics-cert\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.302902 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.302337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-host-run-netns\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.302902 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.302367 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-kubelet-config\") pod \"global-pull-secret-syncer-tsfdc\" (UID: \"e88b57b8-05d6-4e3f-9a01-07c5a05a31ee\") " pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:23.302902 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.302444 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs podName:8ac5555e-e619-4a4f-974a-3597a9455f44 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:23.802364146 +0000 UTC m=+2.979051417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs") pod "network-metrics-daemon-q7c98" (UID: "8ac5555e-e619-4a4f-974a-3597a9455f44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:23.302902 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.302510 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-458pl\" (UniqueName: \"kubernetes.io/projected/eb68389e-de3f-4b1a-ba44-e7bedb7c540f-kube-api-access-458pl\") pod \"iptables-alerter-d5mzs\" (UID: \"eb68389e-de3f-4b1a-ba44-e7bedb7c540f\") " pod="openshift-network-operator/iptables-alerter-d5mzs" Jul 09 13:58:23.308760 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.308739 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:58:23.308760 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.308764 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:58:23.308936 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.308779 2565 projected.go:196] Error preparing data for projected volume kube-api-access-bhrmd for pod openshift-network-diagnostics/network-check-target-hnkjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:23.308936 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.308851 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd podName:899ea887-23f2-4698-8a03-ebcc2f90c392 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:23.808832567 +0000 UTC m=+2.985519861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bhrmd" (UniqueName: "kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd") pod "network-check-target-hnkjm" (UID: "899ea887-23f2-4698-8a03-ebcc2f90c392") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:23.309516 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.309493 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 13:58:23.313381 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.313350 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-458pl\" (UniqueName: \"kubernetes.io/projected/eb68389e-de3f-4b1a-ba44-e7bedb7c540f-kube-api-access-458pl\") pod \"iptables-alerter-d5mzs\" (UID: \"eb68389e-de3f-4b1a-ba44-e7bedb7c540f\") " pod="openshift-network-operator/iptables-alerter-d5mzs" Jul 09 13:58:23.313502 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.313399 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46sq9\" (UniqueName: \"kubernetes.io/projected/8ac5555e-e619-4a4f-974a-3597a9455f44-kube-api-access-46sq9\") pod \"network-metrics-daemon-q7c98\" (UID: \"8ac5555e-e619-4a4f-974a-3597a9455f44\") " pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:23.314004 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.313981 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zrfr\" (UniqueName: \"kubernetes.io/projected/c4c04533-d231-4114-94ac-9cd50a96f6e9-kube-api-access-8zrfr\") pod \"aws-ebs-csi-driver-node-zgt69\" (UID: \"c4c04533-d231-4114-94ac-9cd50a96f6e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.343718 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.343688 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:58:23.351142 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.351024 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" event={"ID":"27d6497d34fdf915d7c702237be63dc6","Type":"ContainerStarted","Data":"f8328451724783b9afa6ecf4b250c4ec89ebf9b9dea0d8628dcb2b82311ec701"} Jul 09 13:58:23.352579 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.352523 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" event={"ID":"f671eeaf614c8d693fab4bd5bb741bfd","Type":"ContainerStarted","Data":"47fa05a1616cd64834d61b23a45d1670046ff7495a4e11c618cbaeb499a5ecd7"} Jul 09 13:58:23.403003 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.402953 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-multus-socket-dir-parent\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.403003 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403003 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/549e0930-0906-4ecd-9d31-4b6cd6a38d96-agent-certs\") pod \"konnectivity-agent-6b4n4\" (UID: \"549e0930-0906-4ecd-9d31-4b6cd6a38d96\") " pod="kube-system/konnectivity-agent-6b4n4" Jul 09 13:58:23.403294 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403048 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8934e636-88e3-45a1-abbc-f86ce7972aaa-ovnkube-config\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.403294 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403078 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4-hosts-file\") pod \"node-resolver-nq5wm\" (UID: \"f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4\") " pod="openshift-dns/node-resolver-nq5wm" Jul 09 13:58:23.403294 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403104 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-etc-sysconfig\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.403294 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403126 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9be55c13-b339-4f55-86d2-4342f11d973c-etc-tuned\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.403294 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403158 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9be55c13-b339-4f55-86d2-4342f11d973c-tmp\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.403294 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403182 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31a27df1-dfcb-48d4-aa08-074d2ee3220b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.403294 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403205 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-run-ovn-kubernetes\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.403294 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403227 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-cni-bin\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.403294 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403254 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6368ef5c-3229-4983-8799-36ea627d4ee2-multus-daemon-config\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.403294 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403279 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-run-systemd\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.403845 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-node-log\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.403845 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403324 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-run\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.403845 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403345 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-os-release\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.403845 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403371 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-log-socket\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.403845 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403409 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55-host\") pod \"node-ca-m6jmd\" (UID: \"cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55\") " pod="openshift-image-registry/node-ca-m6jmd" Jul 09 13:58:23.403845 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403436 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-host-run-k8s-cni-cncf-io\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.403845 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403459 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-host-var-lib-cni-bin\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.403845 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403495 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-multus-conf-dir\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.403845 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403519 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmmrt\" (UniqueName: \"kubernetes.io/projected/6368ef5c-3229-4983-8799-36ea627d4ee2-kube-api-access-kmmrt\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.403845 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403543 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-etc-sysctl-d\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.403845 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403566 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-etc-kubernetes\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.403845 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403593 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsr4p\" (UniqueName: \"kubernetes.io/projected/9be55c13-b339-4f55-86d2-4342f11d973c-kube-api-access-lsr4p\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.403845 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403617 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4-tmp-dir\") pod \"node-resolver-nq5wm\" (UID: \"f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4\") " pod="openshift-dns/node-resolver-nq5wm" Jul 09 13:58:23.403845 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403640 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-lib-modules\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.403845 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403665 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31a27df1-dfcb-48d4-aa08-074d2ee3220b-cnibin\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.403845 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403697 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-run-netns\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.403845 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403713 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-node-log\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.403845 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403739 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8934e636-88e3-45a1-abbc-f86ce7972aaa-env-overrides\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.404753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403803 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-etc-sysctl-conf\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.404753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403835 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktnsh\" (UniqueName: \"kubernetes.io/projected/31a27df1-dfcb-48d4-aa08-074d2ee3220b-kube-api-access-ktnsh\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.404753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403862 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-kubelet\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.404753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403889 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-slash\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.404753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403920 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-cni-netd\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.404753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403947 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8934e636-88e3-45a1-abbc-f86ce7972aaa-ovnkube-script-lib\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.404753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403976 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55-serviceca\") pod \"node-ca-m6jmd\" (UID: \"cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55\") " pod="openshift-image-registry/node-ca-m6jmd" Jul 09 13:58:23.404753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404001 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-host\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.404753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404029 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.404753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404057 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-etc-systemd\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.404753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404092 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-multus-cni-dir\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.404753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404104 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55-host\") pod \"node-ca-m6jmd\" (UID: \"cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55\") " pod="openshift-image-registry/node-ca-m6jmd" Jul 09 13:58:23.404753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404118 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-cnibin\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.404753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404167 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-multus-conf-dir\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.404753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404220 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-multus-socket-dir-parent\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.404753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404169 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-host-run-k8s-cni-cncf-io\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.404753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404272 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-host-var-lib-cni-bin\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.404753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404332 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-etc-kubernetes\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.405664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404337 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8934e636-88e3-45a1-abbc-f86ce7972aaa-env-overrides\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.405664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404457 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-etc-sysctl-d\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.405664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404472 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-lib-modules\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.405664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404533 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31a27df1-dfcb-48d4-aa08-074d2ee3220b-cnibin\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.405664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404561 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-run-netns\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.405664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404580 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-slash\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.405664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404619 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-run-ovn-kubernetes\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.405664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404630 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.405664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404652 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-log-socket\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.405664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404699 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-cni-netd\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.405664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404060 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-os-release\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.405664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404753 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-etc-systemd\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.405664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404797 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-cnibin\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.405664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404865 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-etc-sysconfig\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.405664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404870 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-multus-cni-dir\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.405664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.404965 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4-tmp-dir\") pod \"node-resolver-nq5wm\" (UID: \"f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4\") " pod="openshift-dns/node-resolver-nq5wm" Jul 09 13:58:23.405664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405054 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-run-systemd\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.405664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405125 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-host\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.406577 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405261 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-etc-sysctl-conf\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.406577 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405261 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8934e636-88e3-45a1-abbc-f86ce7972aaa-ovnkube-config\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.406577 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405363 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-cni-bin\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.406577 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405453 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55-serviceca\") pod \"node-ca-m6jmd\" (UID: \"cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55\") " pod="openshift-image-registry/node-ca-m6jmd" Jul 09 13:58:23.406577 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.403996 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-run\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.406577 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405490 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8934e636-88e3-45a1-abbc-f86ce7972aaa-ovnkube-script-lib\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.406577 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405507 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-host-kubelet\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.406577 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405529 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31a27df1-dfcb-48d4-aa08-074d2ee3220b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.406577 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405541 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-host-var-lib-kubelet\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.406577 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405567 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4-hosts-file\") pod \"node-resolver-nq5wm\" (UID: \"f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4\") " pod="openshift-dns/node-resolver-nq5wm" Jul 09 13:58:23.406577 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405567 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-host-var-lib-kubelet\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.406577 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405590 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-host-run-multus-certs\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.406577 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405632 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-host-run-multus-certs\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.406577 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405657 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/549e0930-0906-4ecd-9d31-4b6cd6a38d96-konnectivity-ca\") pod \"konnectivity-agent-6b4n4\" (UID: \"549e0930-0906-4ecd-9d31-4b6cd6a38d96\") " pod="kube-system/konnectivity-agent-6b4n4" Jul 09 13:58:23.406577 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405686 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4wgn\" (UniqueName: \"kubernetes.io/projected/f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4-kube-api-access-m4wgn\") pod \"node-resolver-nq5wm\" (UID: \"f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4\") " pod="openshift-dns/node-resolver-nq5wm" Jul 09 13:58:23.406577 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405712 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-host-var-lib-cni-multus\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.406577 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405759 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-etc-kubernetes\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.406577 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405783 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-dbus\") pod \"global-pull-secret-syncer-tsfdc\" (UID: \"e88b57b8-05d6-4e3f-9a01-07c5a05a31ee\") " pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:23.407526 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405811 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret\") pod \"global-pull-secret-syncer-tsfdc\" (UID: \"e88b57b8-05d6-4e3f-9a01-07c5a05a31ee\") " pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:23.407526 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405835 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31a27df1-dfcb-48d4-aa08-074d2ee3220b-system-cni-dir\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.407526 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405860 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31a27df1-dfcb-48d4-aa08-074d2ee3220b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.407526 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405888 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/31a27df1-dfcb-48d4-aa08-074d2ee3220b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.407526 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405917 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-hostroot\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.407526 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405958 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-var-lib-kubelet\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.407526 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.405983 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/31a27df1-dfcb-48d4-aa08-074d2ee3220b-os-release\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.407526 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406008 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/31a27df1-dfcb-48d4-aa08-074d2ee3220b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.407526 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406038 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-systemd-units\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.407526 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406062 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-etc-openvswitch\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.407526 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406063 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-host-var-lib-cni-multus\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.407526 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406089 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8934e636-88e3-45a1-abbc-f86ce7972aaa-ovn-node-metrics-cert\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.407526 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406115 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-etc-kubernetes\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.407526 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406152 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-host-run-netns\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.407526 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406157 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31a27df1-dfcb-48d4-aa08-074d2ee3220b-system-cni-dir\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.407526 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406116 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-host-run-netns\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.407526 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406213 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-kubelet-config\") pod \"global-pull-secret-syncer-tsfdc\" (UID: \"e88b57b8-05d6-4e3f-9a01-07c5a05a31ee\") " pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:23.408478 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406222 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/549e0930-0906-4ecd-9d31-4b6cd6a38d96-konnectivity-ca\") pod \"konnectivity-agent-6b4n4\" (UID: \"549e0930-0906-4ecd-9d31-4b6cd6a38d96\") " pod="kube-system/konnectivity-agent-6b4n4" Jul 09 13:58:23.408478 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406243 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dffk\" (UniqueName: \"kubernetes.io/projected/cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55-kube-api-access-6dffk\") pod \"node-ca-m6jmd\" (UID: \"cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55\") " pod="openshift-image-registry/node-ca-m6jmd" Jul 09 13:58:23.408478 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406270 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-etc-modprobe-d\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.408478 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406295 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-system-cni-dir\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.408478 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6368ef5c-3229-4983-8799-36ea627d4ee2-cni-binary-copy\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.408478 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406352 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-run-openvswitch\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.408478 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406379 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-sys\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.408478 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406406 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-var-lib-openvswitch\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.408478 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406431 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-run-ovn\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.408478 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406460 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvkbk\" (UniqueName: \"kubernetes.io/projected/8934e636-88e3-45a1-abbc-f86ce7972aaa-kube-api-access-zvkbk\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.408478 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406747 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31a27df1-dfcb-48d4-aa08-074d2ee3220b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.408478 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406773 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/31a27df1-dfcb-48d4-aa08-074d2ee3220b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.408478 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406821 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-systemd-units\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.408478 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.406837 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:23.408478 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406896 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-dbus\") pod \"global-pull-secret-syncer-tsfdc\" (UID: \"e88b57b8-05d6-4e3f-9a01-07c5a05a31ee\") " pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:23.408478 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.406906 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret podName:e88b57b8-05d6-4e3f-9a01-07c5a05a31ee nodeName:}" failed. No retries permitted until 2026-07-09 13:58:23.906888117 +0000 UTC m=+3.083575401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret") pod "global-pull-secret-syncer-tsfdc" (UID: "e88b57b8-05d6-4e3f-9a01-07c5a05a31ee") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:23.408478 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.406991 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-etc-modprobe-d\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.409405 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.407039 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-etc-openvswitch\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.409405 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.407040 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-kubelet-config\") pod \"global-pull-secret-syncer-tsfdc\" (UID: \"e88b57b8-05d6-4e3f-9a01-07c5a05a31ee\") " pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:23.409405 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.407101 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-run-openvswitch\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.409405 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.407154 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-var-lib-kubelet\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.409405 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.407197 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-hostroot\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.409405 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.407328 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/31a27df1-dfcb-48d4-aa08-074d2ee3220b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.409405 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.407422 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/31a27df1-dfcb-48d4-aa08-074d2ee3220b-os-release\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.409405 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.407479 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-var-lib-openvswitch\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.409405 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.407542 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/549e0930-0906-4ecd-9d31-4b6cd6a38d96-agent-certs\") pod \"konnectivity-agent-6b4n4\" (UID: \"549e0930-0906-4ecd-9d31-4b6cd6a38d96\") " pod="kube-system/konnectivity-agent-6b4n4" Jul 09 13:58:23.409405 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.407558 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9be55c13-b339-4f55-86d2-4342f11d973c-sys\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.409405 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.407590 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9be55c13-b339-4f55-86d2-4342f11d973c-etc-tuned\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.409405 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.407603 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8934e636-88e3-45a1-abbc-f86ce7972aaa-run-ovn\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.409405 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.407634 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6368ef5c-3229-4983-8799-36ea627d4ee2-system-cni-dir\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.409405 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.408150 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6368ef5c-3229-4983-8799-36ea627d4ee2-cni-binary-copy\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.409405 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.408150 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6368ef5c-3229-4983-8799-36ea627d4ee2-multus-daemon-config\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.409405 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.408757 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9be55c13-b339-4f55-86d2-4342f11d973c-tmp\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.410263 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.410226 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8934e636-88e3-45a1-abbc-f86ce7972aaa-ovn-node-metrics-cert\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.413640 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.413389 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmmrt\" (UniqueName: \"kubernetes.io/projected/6368ef5c-3229-4983-8799-36ea627d4ee2-kube-api-access-kmmrt\") pod \"multus-xgq5t\" (UID: \"6368ef5c-3229-4983-8799-36ea627d4ee2\") " pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.414119 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.414092 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsr4p\" (UniqueName: \"kubernetes.io/projected/9be55c13-b339-4f55-86d2-4342f11d973c-kube-api-access-lsr4p\") pod \"tuned-p2zgn\" (UID: \"9be55c13-b339-4f55-86d2-4342f11d973c\") " pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.414383 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.414347 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4wgn\" (UniqueName: \"kubernetes.io/projected/f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4-kube-api-access-m4wgn\") pod \"node-resolver-nq5wm\" (UID: \"f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4\") " pod="openshift-dns/node-resolver-nq5wm" Jul 09 13:58:23.414941 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.414911 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktnsh\" (UniqueName: \"kubernetes.io/projected/31a27df1-dfcb-48d4-aa08-074d2ee3220b-kube-api-access-ktnsh\") pod \"multus-additional-cni-plugins-jbdq5\" (UID: \"31a27df1-dfcb-48d4-aa08-074d2ee3220b\") " pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.417410 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.417354 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvkbk\" (UniqueName: \"kubernetes.io/projected/8934e636-88e3-45a1-abbc-f86ce7972aaa-kube-api-access-zvkbk\") pod \"ovnkube-node-msflv\" (UID: \"8934e636-88e3-45a1-abbc-f86ce7972aaa\") " pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.417853 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.417828 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dffk\" (UniqueName: \"kubernetes.io/projected/cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55-kube-api-access-6dffk\") pod \"node-ca-m6jmd\" (UID: \"cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55\") " pod="openshift-image-registry/node-ca-m6jmd" Jul 09 13:58:23.497250 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.497206 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" Jul 09 13:58:23.507712 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.507663 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d5mzs" Jul 09 13:58:23.520866 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.520841 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:23.529010 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.528990 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nq5wm" Jul 09 13:58:23.537895 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.537873 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6b4n4" Jul 09 13:58:23.545618 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.545593 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m6jmd" Jul 09 13:58:23.560544 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.560514 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" Jul 09 13:58:23.569412 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.569386 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jbdq5" Jul 09 13:58:23.577454 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.577433 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xgq5t" Jul 09 13:58:23.810640 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.810304 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs\") pod \"network-metrics-daemon-q7c98\" (UID: \"8ac5555e-e619-4a4f-974a-3597a9455f44\") " pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:23.810640 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.810375 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhrmd\" (UniqueName: \"kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd\") pod \"network-check-target-hnkjm\" (UID: \"899ea887-23f2-4698-8a03-ebcc2f90c392\") " pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:23.810640 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.810470 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:23.810640 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.810529 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:58:23.810640 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.810545 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:58:23.810640 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.810552 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs podName:8ac5555e-e619-4a4f-974a-3597a9455f44 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:24.810530433 +0000 UTC m=+3.987217713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs") pod "network-metrics-daemon-q7c98" (UID: "8ac5555e-e619-4a4f-974a-3597a9455f44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:23.810640 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.810559 2565 projected.go:196] Error preparing data for projected volume kube-api-access-bhrmd for pod openshift-network-diagnostics/network-check-target-hnkjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:23.810640 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.810603 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd podName:899ea887-23f2-4698-8a03-ebcc2f90c392 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:24.810588335 +0000 UTC m=+3.987275624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bhrmd" (UniqueName: "kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd") pod "network-check-target-hnkjm" (UID: "899ea887-23f2-4698-8a03-ebcc2f90c392") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:23.911629 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:23.911578 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret\") pod \"global-pull-secret-syncer-tsfdc\" (UID: \"e88b57b8-05d6-4e3f-9a01-07c5a05a31ee\") " pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:23.911826 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.911741 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:23.911826 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:23.911811 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret podName:e88b57b8-05d6-4e3f-9a01-07c5a05a31ee nodeName:}" failed. No retries permitted until 2026-07-09 13:58:24.911791556 +0000 UTC m=+4.088478847 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret") pod "global-pull-secret-syncer-tsfdc" (UID: "e88b57b8-05d6-4e3f-9a01-07c5a05a31ee") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:24.236489 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:24.236359 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:53:23 +0000 UTC" deadline="2027-12-18 04:24:25.468007059 +0000 UTC" Jul 09 13:58:24.236489 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:24.236419 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12638h26m1.231593003s" Jul 09 13:58:24.345768 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:24.345732 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:24.345961 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:24.345932 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsfdc" podUID="e88b57b8-05d6-4e3f-9a01-07c5a05a31ee" Jul 09 13:58:24.346009 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:24.345972 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:24.346100 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:24.346081 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnkjm" podUID="899ea887-23f2-4698-8a03-ebcc2f90c392" Jul 09 13:58:24.413878 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:24.413590 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8934e636_88e3_45a1_abbc_f86ce7972aaa.slice/crio-7e29bd4b29099c89e1a7066bf6419381f86b379c10c6bf38ae12fb07f216508b WatchSource:0}: Error finding container 7e29bd4b29099c89e1a7066bf6419381f86b379c10c6bf38ae12fb07f216508b: Status 404 returned error can't find the container with id 7e29bd4b29099c89e1a7066bf6419381f86b379c10c6bf38ae12fb07f216508b Jul 09 13:58:24.414875 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:24.414845 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91c8d3e_09f7_4fb4_bbde_0ef27d189ca4.slice/crio-be316383721ef6fb6d219eed36ca1b3b61b4dbda9a5bf2409d0c37d7d66a1145 WatchSource:0}: Error finding container be316383721ef6fb6d219eed36ca1b3b61b4dbda9a5bf2409d0c37d7d66a1145: Status 404 returned error can't find the container with id be316383721ef6fb6d219eed36ca1b3b61b4dbda9a5bf2409d0c37d7d66a1145 Jul 09 13:58:24.416576 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:24.416552 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb68389e_de3f_4b1a_ba44_e7bedb7c540f.slice/crio-f0abf0c0cc9554814956fb3046a60950ba8968fd7a9e46a52f619a4b7806d152 WatchSource:0}: Error finding container f0abf0c0cc9554814956fb3046a60950ba8968fd7a9e46a52f619a4b7806d152: Status 404 returned error can't find the container with id f0abf0c0cc9554814956fb3046a60950ba8968fd7a9e46a52f619a4b7806d152 Jul 09 13:58:24.419497 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:24.419471 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc73a2bb_9ae3_47e4_9ead_1f27eb7a4b55.slice/crio-dd106c6327c4878829abb4e958b30154aa4c48c73e23322232ca7301f31ec5ae WatchSource:0}: Error finding container dd106c6327c4878829abb4e958b30154aa4c48c73e23322232ca7301f31ec5ae: Status 404 returned error can't find the container with id dd106c6327c4878829abb4e958b30154aa4c48c73e23322232ca7301f31ec5ae Jul 09 13:58:24.422263 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:24.421879 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9be55c13_b339_4f55_86d2_4342f11d973c.slice/crio-56dd35eddb24480dcec83a9e11f808adafa0aba71322efa659aecac4af5aa197 WatchSource:0}: Error finding container 56dd35eddb24480dcec83a9e11f808adafa0aba71322efa659aecac4af5aa197: Status 404 returned error can't find the container with id 56dd35eddb24480dcec83a9e11f808adafa0aba71322efa659aecac4af5aa197 Jul 09 13:58:24.422637 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:24.422258 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod549e0930_0906_4ecd_9d31_4b6cd6a38d96.slice/crio-4b29314a90de934c5ee4e14ad4072338806a6d7f1c66b9bc3ce8028bb44cfd7d WatchSource:0}: Error finding container 4b29314a90de934c5ee4e14ad4072338806a6d7f1c66b9bc3ce8028bb44cfd7d: Status 404 returned error can't find the container with id 4b29314a90de934c5ee4e14ad4072338806a6d7f1c66b9bc3ce8028bb44cfd7d Jul 09 13:58:24.424097 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:24.424041 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6368ef5c_3229_4983_8799_36ea627d4ee2.slice/crio-89ab29d62ef8750addeb89ce026c1a457218d6983c41909235d3e4b7eb257e80 WatchSource:0}: Error finding container 89ab29d62ef8750addeb89ce026c1a457218d6983c41909235d3e4b7eb257e80: Status 404 returned error can't find the container with id 89ab29d62ef8750addeb89ce026c1a457218d6983c41909235d3e4b7eb257e80 Jul 09 13:58:24.426124 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:24.425860 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4c04533_d231_4114_94ac_9cd50a96f6e9.slice/crio-487843e0148a7a199c02dfc595d9a954e1de8a89667d8a6918270616b12f5a05 WatchSource:0}: Error finding container 487843e0148a7a199c02dfc595d9a954e1de8a89667d8a6918270616b12f5a05: Status 404 returned error can't find the container with id 487843e0148a7a199c02dfc595d9a954e1de8a89667d8a6918270616b12f5a05 Jul 09 13:58:24.818776 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:24.818654 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs\") pod \"network-metrics-daemon-q7c98\" (UID: \"8ac5555e-e619-4a4f-974a-3597a9455f44\") " pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:24.818776 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:24.818755 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhrmd\" (UniqueName: \"kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd\") pod \"network-check-target-hnkjm\" (UID: \"899ea887-23f2-4698-8a03-ebcc2f90c392\") " pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:24.818995 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:24.818869 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:24.818995 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:24.818906 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:58:24.818995 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:24.818923 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:58:24.818995 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:24.818934 2565 projected.go:196] Error preparing data for projected volume kube-api-access-bhrmd for pod openshift-network-diagnostics/network-check-target-hnkjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:24.818995 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:24.818982 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs podName:8ac5555e-e619-4a4f-974a-3597a9455f44 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:26.818959499 +0000 UTC m=+5.995646786 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs") pod "network-metrics-daemon-q7c98" (UID: "8ac5555e-e619-4a4f-974a-3597a9455f44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:24.819250 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:24.819005 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd podName:899ea887-23f2-4698-8a03-ebcc2f90c392 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:26.818994077 +0000 UTC m=+5.995681362 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bhrmd" (UniqueName: "kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd") pod "network-check-target-hnkjm" (UID: "899ea887-23f2-4698-8a03-ebcc2f90c392") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:24.919435 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:24.919395 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret\") pod \"global-pull-secret-syncer-tsfdc\" (UID: \"e88b57b8-05d6-4e3f-9a01-07c5a05a31ee\") " pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:24.919619 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:24.919574 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:24.919704 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:24.919654 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret podName:e88b57b8-05d6-4e3f-9a01-07c5a05a31ee nodeName:}" failed. No retries permitted until 2026-07-09 13:58:26.91963112 +0000 UTC m=+6.096318447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret") pod "global-pull-secret-syncer-tsfdc" (UID: "e88b57b8-05d6-4e3f-9a01-07c5a05a31ee") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:25.236781 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:25.236609 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:53:23 +0000 UTC" deadline="2028-02-24 19:21:35.963345323 +0000 UTC" Jul 09 13:58:25.236781 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:25.236691 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14285h23m10.726658368s" Jul 09 13:58:25.346890 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:25.346855 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:25.347120 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:25.347014 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7c98" podUID="8ac5555e-e619-4a4f-974a-3597a9455f44" Jul 09 13:58:25.366773 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:25.366659 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" event={"ID":"8934e636-88e3-45a1-abbc-f86ce7972aaa","Type":"ContainerStarted","Data":"7e29bd4b29099c89e1a7066bf6419381f86b379c10c6bf38ae12fb07f216508b"} Jul 09 13:58:25.381294 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:25.381259 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" event={"ID":"f671eeaf614c8d693fab4bd5bb741bfd","Type":"ContainerStarted","Data":"475c1a2f2fc3dbacc92af628ddf44fdbb1ad6fa0b8be2dd436b3adff3f4b09ac"} Jul 09 13:58:25.391357 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:25.391286 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xgq5t" event={"ID":"6368ef5c-3229-4983-8799-36ea627d4ee2","Type":"ContainerStarted","Data":"89ab29d62ef8750addeb89ce026c1a457218d6983c41909235d3e4b7eb257e80"} Jul 09 13:58:25.400968 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:25.400896 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" event={"ID":"9be55c13-b339-4f55-86d2-4342f11d973c","Type":"ContainerStarted","Data":"56dd35eddb24480dcec83a9e11f808adafa0aba71322efa659aecac4af5aa197"} Jul 09 13:58:25.411762 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:25.410813 2565 generic.go:356] "Generic (PLEG): container finished" podID="27d6497d34fdf915d7c702237be63dc6" containerID="d2bfa221754e87cc97727cc6dfcd311e1fd9aabc8b8e01d2b70a51d89fbaadfc" exitCode=0 Jul 09 13:58:25.411762 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:25.410897 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" event={"ID":"27d6497d34fdf915d7c702237be63dc6","Type":"ContainerDied","Data":"d2bfa221754e87cc97727cc6dfcd311e1fd9aabc8b8e01d2b70a51d89fbaadfc"} Jul 09 13:58:25.419345 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:25.417277 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbdq5" event={"ID":"31a27df1-dfcb-48d4-aa08-074d2ee3220b","Type":"ContainerStarted","Data":"cfa31b9724217e7bb6d238b12c4f51928b8fb7496cabb2590094efd5bb86aee5"} Jul 09 13:58:25.428873 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:25.428780 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" event={"ID":"c4c04533-d231-4114-94ac-9cd50a96f6e9","Type":"ContainerStarted","Data":"487843e0148a7a199c02dfc595d9a954e1de8a89667d8a6918270616b12f5a05"} Jul 09 13:58:25.430910 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:25.430329 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-155.ec2.internal" podStartSLOduration=2.430309061 podStartE2EDuration="2.430309061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:25.411549184 +0000 UTC m=+4.588236480" watchObservedRunningTime="2026-07-09 13:58:25.430309061 +0000 UTC m=+4.606996361" Jul 09 13:58:25.435382 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:25.435353 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6b4n4" event={"ID":"549e0930-0906-4ecd-9d31-4b6cd6a38d96","Type":"ContainerStarted","Data":"4b29314a90de934c5ee4e14ad4072338806a6d7f1c66b9bc3ce8028bb44cfd7d"} Jul 09 13:58:25.448471 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:25.448437 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m6jmd" event={"ID":"cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55","Type":"ContainerStarted","Data":"dd106c6327c4878829abb4e958b30154aa4c48c73e23322232ca7301f31ec5ae"} Jul 09 13:58:25.454245 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:25.453140 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d5mzs" event={"ID":"eb68389e-de3f-4b1a-ba44-e7bedb7c540f","Type":"ContainerStarted","Data":"f0abf0c0cc9554814956fb3046a60950ba8968fd7a9e46a52f619a4b7806d152"} Jul 09 13:58:25.470020 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:25.469989 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nq5wm" event={"ID":"f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4","Type":"ContainerStarted","Data":"be316383721ef6fb6d219eed36ca1b3b61b4dbda9a5bf2409d0c37d7d66a1145"} Jul 09 13:58:26.346050 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:26.346014 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:26.346546 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:26.346159 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsfdc" podUID="e88b57b8-05d6-4e3f-9a01-07c5a05a31ee" Jul 09 13:58:26.346612 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:26.346563 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:26.346684 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:26.346659 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnkjm" podUID="899ea887-23f2-4698-8a03-ebcc2f90c392" Jul 09 13:58:26.494520 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:26.494480 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" event={"ID":"27d6497d34fdf915d7c702237be63dc6","Type":"ContainerStarted","Data":"dac1affba43af01dd1cba969e2b721a7d9c831ef226357ef75bcfa7b6dc4f442"} Jul 09 13:58:26.526071 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:26.526012 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-155.ec2.internal" podStartSLOduration=3.525990335 podStartE2EDuration="3.525990335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:26.524877392 +0000 UTC m=+5.701564686" watchObservedRunningTime="2026-07-09 13:58:26.525990335 +0000 UTC m=+5.702677629" Jul 09 13:58:26.834738 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:26.834296 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs\") pod \"network-metrics-daemon-q7c98\" (UID: \"8ac5555e-e619-4a4f-974a-3597a9455f44\") " pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:26.834738 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:26.834373 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhrmd\" (UniqueName: \"kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd\") pod \"network-check-target-hnkjm\" (UID: \"899ea887-23f2-4698-8a03-ebcc2f90c392\") " pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:26.834738 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:26.834557 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:58:26.834738 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:26.834577 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:58:26.834738 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:26.834590 2565 projected.go:196] Error preparing data for projected volume kube-api-access-bhrmd for pod openshift-network-diagnostics/network-check-target-hnkjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:26.835075 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:26.834744 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd podName:899ea887-23f2-4698-8a03-ebcc2f90c392 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:30.834720782 +0000 UTC m=+10.011408071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bhrmd" (UniqueName: "kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd") pod "network-check-target-hnkjm" (UID: "899ea887-23f2-4698-8a03-ebcc2f90c392") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:26.835217 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:26.835151 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:26.835217 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:26.835209 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs podName:8ac5555e-e619-4a4f-974a-3597a9455f44 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:30.835194451 +0000 UTC m=+10.011881727 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs") pod "network-metrics-daemon-q7c98" (UID: "8ac5555e-e619-4a4f-974a-3597a9455f44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:26.935690 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:26.935477 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret\") pod \"global-pull-secret-syncer-tsfdc\" (UID: \"e88b57b8-05d6-4e3f-9a01-07c5a05a31ee\") " pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:26.936371 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:26.935638 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:26.936371 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:26.936030 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret podName:e88b57b8-05d6-4e3f-9a01-07c5a05a31ee nodeName:}" failed. No retries permitted until 2026-07-09 13:58:30.936006581 +0000 UTC m=+10.112693859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret") pod "global-pull-secret-syncer-tsfdc" (UID: "e88b57b8-05d6-4e3f-9a01-07c5a05a31ee") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:27.347820 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:27.347788 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:27.348272 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:27.347932 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7c98" podUID="8ac5555e-e619-4a4f-974a-3597a9455f44" Jul 09 13:58:28.345979 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:28.345943 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:28.345979 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:28.345973 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:28.346224 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:28.346092 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsfdc" podUID="e88b57b8-05d6-4e3f-9a01-07c5a05a31ee" Jul 09 13:58:28.346514 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:28.346488 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnkjm" podUID="899ea887-23f2-4698-8a03-ebcc2f90c392" Jul 09 13:58:29.347191 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:29.346674 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:29.347191 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:29.346821 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7c98" podUID="8ac5555e-e619-4a4f-974a-3597a9455f44" Jul 09 13:58:30.345886 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:30.345854 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:30.346067 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:30.345854 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:30.346067 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:30.345976 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnkjm" podUID="899ea887-23f2-4698-8a03-ebcc2f90c392" Jul 09 13:58:30.346189 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:30.346063 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsfdc" podUID="e88b57b8-05d6-4e3f-9a01-07c5a05a31ee" Jul 09 13:58:30.867893 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:30.867857 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs\") pod \"network-metrics-daemon-q7c98\" (UID: \"8ac5555e-e619-4a4f-974a-3597a9455f44\") " pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:30.868362 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:30.867926 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhrmd\" (UniqueName: \"kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd\") pod \"network-check-target-hnkjm\" (UID: \"899ea887-23f2-4698-8a03-ebcc2f90c392\") " pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:30.868362 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:30.868058 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:58:30.868362 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:30.868058 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:30.868362 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:30.868076 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:58:30.868362 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:30.868089 2565 projected.go:196] Error preparing data for projected volume kube-api-access-bhrmd for pod openshift-network-diagnostics/network-check-target-hnkjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:30.868362 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:30.868139 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs podName:8ac5555e-e619-4a4f-974a-3597a9455f44 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:38.868117262 +0000 UTC m=+18.044804552 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs") pod "network-metrics-daemon-q7c98" (UID: "8ac5555e-e619-4a4f-974a-3597a9455f44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:30.868362 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:30.868160 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd podName:899ea887-23f2-4698-8a03-ebcc2f90c392 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:38.868149811 +0000 UTC m=+18.044837081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bhrmd" (UniqueName: "kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd") pod "network-check-target-hnkjm" (UID: "899ea887-23f2-4698-8a03-ebcc2f90c392") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:30.969641 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:30.969066 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret\") pod \"global-pull-secret-syncer-tsfdc\" (UID: \"e88b57b8-05d6-4e3f-9a01-07c5a05a31ee\") " pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:30.969641 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:30.969243 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:30.969641 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:30.969300 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret podName:e88b57b8-05d6-4e3f-9a01-07c5a05a31ee nodeName:}" failed. No retries permitted until 2026-07-09 13:58:38.969282982 +0000 UTC m=+18.145970259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret") pod "global-pull-secret-syncer-tsfdc" (UID: "e88b57b8-05d6-4e3f-9a01-07c5a05a31ee") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:31.347100 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:31.347014 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:31.347265 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:31.347161 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7c98" podUID="8ac5555e-e619-4a4f-974a-3597a9455f44" Jul 09 13:58:32.346527 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:32.345918 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:32.346527 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:32.346053 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsfdc" podUID="e88b57b8-05d6-4e3f-9a01-07c5a05a31ee" Jul 09 13:58:32.346527 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:32.346380 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:32.346527 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:32.346483 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnkjm" podUID="899ea887-23f2-4698-8a03-ebcc2f90c392" Jul 09 13:58:33.346788 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:33.346274 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:33.346788 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:33.346415 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7c98" podUID="8ac5555e-e619-4a4f-974a-3597a9455f44" Jul 09 13:58:34.345176 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:34.345143 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:34.345365 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:34.345304 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsfdc" podUID="e88b57b8-05d6-4e3f-9a01-07c5a05a31ee" Jul 09 13:58:34.345365 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:34.345341 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:34.345500 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:34.345430 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnkjm" podUID="899ea887-23f2-4698-8a03-ebcc2f90c392" Jul 09 13:58:35.345309 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:35.345278 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:35.345670 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:35.345386 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7c98" podUID="8ac5555e-e619-4a4f-974a-3597a9455f44" Jul 09 13:58:36.346134 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:36.346099 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:36.346587 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:36.346224 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsfdc" podUID="e88b57b8-05d6-4e3f-9a01-07c5a05a31ee" Jul 09 13:58:36.346587 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:36.346268 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:36.346587 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:36.346351 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnkjm" podUID="899ea887-23f2-4698-8a03-ebcc2f90c392" Jul 09 13:58:37.345510 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:37.345471 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:37.345744 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:37.345628 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7c98" podUID="8ac5555e-e619-4a4f-974a-3597a9455f44" Jul 09 13:58:38.346246 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:38.346209 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:38.346246 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:38.346237 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:38.346808 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:38.346339 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsfdc" podUID="e88b57b8-05d6-4e3f-9a01-07c5a05a31ee" Jul 09 13:58:38.346808 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:38.346416 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnkjm" podUID="899ea887-23f2-4698-8a03-ebcc2f90c392" Jul 09 13:58:38.930442 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:38.930406 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs\") pod \"network-metrics-daemon-q7c98\" (UID: \"8ac5555e-e619-4a4f-974a-3597a9455f44\") " pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:38.930696 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:38.930458 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhrmd\" (UniqueName: \"kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd\") pod \"network-check-target-hnkjm\" (UID: \"899ea887-23f2-4698-8a03-ebcc2f90c392\") " pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:38.930696 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:38.930577 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:38.930696 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:38.930661 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs podName:8ac5555e-e619-4a4f-974a-3597a9455f44 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:54.930630747 +0000 UTC m=+34.107318029 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs") pod "network-metrics-daemon-q7c98" (UID: "8ac5555e-e619-4a4f-974a-3597a9455f44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:38.930696 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:38.930585 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:58:38.930873 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:38.930706 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:58:38.930873 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:38.930724 2565 projected.go:196] Error preparing data for projected volume kube-api-access-bhrmd for pod openshift-network-diagnostics/network-check-target-hnkjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:38.930873 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:38.930780 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd podName:899ea887-23f2-4698-8a03-ebcc2f90c392 nodeName:}" failed. No retries permitted until 2026-07-09 13:58:54.930764769 +0000 UTC m=+34.107452051 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bhrmd" (UniqueName: "kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd") pod "network-check-target-hnkjm" (UID: "899ea887-23f2-4698-8a03-ebcc2f90c392") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:39.030904 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:39.030860 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret\") pod \"global-pull-secret-syncer-tsfdc\" (UID: \"e88b57b8-05d6-4e3f-9a01-07c5a05a31ee\") " pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:39.031065 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:39.031026 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:39.031107 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:39.031091 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret podName:e88b57b8-05d6-4e3f-9a01-07c5a05a31ee nodeName:}" failed. No retries permitted until 2026-07-09 13:58:55.031076073 +0000 UTC m=+34.207763346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret") pod "global-pull-secret-syncer-tsfdc" (UID: "e88b57b8-05d6-4e3f-9a01-07c5a05a31ee") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:39.345895 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:39.345816 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:39.346056 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:39.345945 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7c98" podUID="8ac5555e-e619-4a4f-974a-3597a9455f44" Jul 09 13:58:40.346083 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:40.346049 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:40.346531 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:40.346048 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:40.346531 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:40.346185 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnkjm" podUID="899ea887-23f2-4698-8a03-ebcc2f90c392" Jul 09 13:58:40.346531 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:40.346288 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsfdc" podUID="e88b57b8-05d6-4e3f-9a01-07c5a05a31ee" Jul 09 13:58:41.345910 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:41.345872 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:41.346107 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:41.345991 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7c98" podUID="8ac5555e-e619-4a4f-974a-3597a9455f44" Jul 09 13:58:42.346171 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:42.346135 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:42.346587 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:42.346141 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:42.346587 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:42.346348 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsfdc" podUID="e88b57b8-05d6-4e3f-9a01-07c5a05a31ee" Jul 09 13:58:42.346587 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:42.346237 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnkjm" podUID="899ea887-23f2-4698-8a03-ebcc2f90c392" Jul 09 13:58:43.346267 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:43.346217 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:43.346781 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:43.346337 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7c98" podUID="8ac5555e-e619-4a4f-974a-3597a9455f44" Jul 09 13:58:44.345698 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.345445 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:44.345880 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.345490 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:44.345880 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:44.345802 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsfdc" podUID="e88b57b8-05d6-4e3f-9a01-07c5a05a31ee" Jul 09 13:58:44.345985 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:44.345896 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnkjm" podUID="899ea887-23f2-4698-8a03-ebcc2f90c392" Jul 09 13:58:44.557871 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.557834 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xgq5t" event={"ID":"6368ef5c-3229-4983-8799-36ea627d4ee2","Type":"ContainerStarted","Data":"8ac3c946ec023f1e3d5cd76357c9c738580646881d6264260fb9561866a29800"} Jul 09 13:58:44.559303 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.559280 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" event={"ID":"9be55c13-b339-4f55-86d2-4342f11d973c","Type":"ContainerStarted","Data":"3185673845f15fbdbdbeb82355db971c4ced7c2b21928d36038af6a6e2336829"} Jul 09 13:58:44.560658 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.560623 2565 generic.go:356] "Generic (PLEG): container finished" podID="31a27df1-dfcb-48d4-aa08-074d2ee3220b" containerID="e27a3028c761e23beb1c8c039435ab6ebf0f1cb9c304307eb3bd6148c2232029" exitCode=0 Jul 09 13:58:44.560755 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.560710 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbdq5" event={"ID":"31a27df1-dfcb-48d4-aa08-074d2ee3220b","Type":"ContainerDied","Data":"e27a3028c761e23beb1c8c039435ab6ebf0f1cb9c304307eb3bd6148c2232029"} Jul 09 13:58:44.562114 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.562093 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" event={"ID":"c4c04533-d231-4114-94ac-9cd50a96f6e9","Type":"ContainerStarted","Data":"da2c172fc1a820de6630c689cb13075bf34899a1b23db58d8c8aefeb5c1ed709"} Jul 09 13:58:44.563405 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.563387 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6b4n4" event={"ID":"549e0930-0906-4ecd-9d31-4b6cd6a38d96","Type":"ContainerStarted","Data":"a026c09c52eb835343edc15eb3805f8916dcb9ccadefdabbea926d8f6798eb59"} Jul 09 13:58:44.564739 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.564718 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m6jmd" event={"ID":"cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55","Type":"ContainerStarted","Data":"4cf059423667c3448059e5e701a58d7179e9e8ed862c61784dd1feb458505c75"} Jul 09 13:58:44.565975 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.565956 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nq5wm" event={"ID":"f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4","Type":"ContainerStarted","Data":"ce28d5acf07bc26d6b2c2f9fdd6047996f2348e56efcaa4978faac2b23141767"} Jul 09 13:58:44.568338 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.568323 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 13:58:44.568617 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.568597 2565 generic.go:356] "Generic (PLEG): container finished" podID="8934e636-88e3-45a1-abbc-f86ce7972aaa" containerID="5a4a7b68246a139b6713fc184a4d51837538cfe465447c65e358337e9d648112" exitCode=1 Jul 09 13:58:44.568699 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.568628 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" event={"ID":"8934e636-88e3-45a1-abbc-f86ce7972aaa","Type":"ContainerStarted","Data":"ced623fd7a8e9849ac8efe68d9aa8e8b9f219a9273ae0ed7c4225fed5ab47010"} Jul 09 13:58:44.568699 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.568686 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" event={"ID":"8934e636-88e3-45a1-abbc-f86ce7972aaa","Type":"ContainerStarted","Data":"6d86570e58793bd79df374c4003321638382f224b1ac42106a862f205b6f3eb9"} Jul 09 13:58:44.568764 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.568717 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" event={"ID":"8934e636-88e3-45a1-abbc-f86ce7972aaa","Type":"ContainerStarted","Data":"705aa24ba71b11113b24135f373d58bc07a43526b0fd1f5aa50ca649dd8bcbdd"} Jul 09 13:58:44.568764 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.568751 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" event={"ID":"8934e636-88e3-45a1-abbc-f86ce7972aaa","Type":"ContainerStarted","Data":"d840a63602a9d3d09ffb76787725df0e583c6832446406b159e974ed212f9ade"} Jul 09 13:58:44.568826 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.568778 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" event={"ID":"8934e636-88e3-45a1-abbc-f86ce7972aaa","Type":"ContainerDied","Data":"5a4a7b68246a139b6713fc184a4d51837538cfe465447c65e358337e9d648112"} Jul 09 13:58:44.568826 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.568806 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" event={"ID":"8934e636-88e3-45a1-abbc-f86ce7972aaa","Type":"ContainerStarted","Data":"0e8d6e0a73cb70052e94d608c9a35cf719059d9e795ba1655ffd5f3b61c0d303"} Jul 09 13:58:44.575314 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.575276 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xgq5t" podStartSLOduration=4.502959048 podStartE2EDuration="23.575264883s" totalImagesPullingTime="19.072305835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:44.575135874 +0000 UTC m=+23.751823166" watchObservedRunningTime="2026-07-09 13:58:44.575264883 +0000 UTC m=+23.751952174" Jul 09 13:58:44.592828 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.592793 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nq5wm" podStartSLOduration=4.576612707 podStartE2EDuration="23.592782954s" totalImagesPullingTime="19.016170247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:44.592409578 +0000 UTC m=+23.769096868" watchObservedRunningTime="2026-07-09 13:58:44.592782954 +0000 UTC m=+23.769470245" Jul 09 13:58:44.607366 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.607332 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6b4n4" podStartSLOduration=8.893431945 podStartE2EDuration="23.607316037s" totalImagesPullingTime="14.713884092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:44.607305581 +0000 UTC m=+23.783992872" watchObservedRunningTime="2026-07-09 13:58:44.607316037 +0000 UTC m=+23.784003332" Jul 09 13:58:44.621802 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.621762 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m6jmd" podStartSLOduration=4.611959279 podStartE2EDuration="23.621751165s" totalImagesPullingTime="19.009791886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:44.621624423 +0000 UTC m=+23.798311715" watchObservedRunningTime="2026-07-09 13:58:44.621751165 +0000 UTC m=+23.798438458" Jul 09 13:58:44.643119 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.643081 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p2zgn" podStartSLOduration=4.613633161 podStartE2EDuration="23.643068642s" totalImagesPullingTime="19.029435481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:44.642902451 +0000 UTC m=+23.819589744" watchObservedRunningTime="2026-07-09 13:58:44.643068642 +0000 UTC m=+23.819755934" Jul 09 13:58:44.825331 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:44.825306 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 13:58:45.266515 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:45.266396 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T13:58:44.825327509Z","UUID":"d869d94c-93d0-4059-92f9-e4a66445e7bf","Handler":null,"Name":"","Endpoint":""} Jul 09 13:58:45.268203 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:45.268181 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 13:58:45.268342 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:45.268226 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 13:58:45.346137 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:45.345939 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:45.346137 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:45.346095 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7c98" podUID="8ac5555e-e619-4a4f-974a-3597a9455f44" Jul 09 13:58:45.573730 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:45.573632 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" event={"ID":"c4c04533-d231-4114-94ac-9cd50a96f6e9","Type":"ContainerStarted","Data":"e731f2b172a200c77cf8d279034d7c5b3e30f4051380584d69bf7226dca52c24"} Jul 09 13:58:45.575771 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:45.575740 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d5mzs" event={"ID":"eb68389e-de3f-4b1a-ba44-e7bedb7c540f","Type":"ContainerStarted","Data":"6e73e2e3d6ad7e46bd90da9fbdd9bb8cf9340b2c8f25442a8cc0d0ec8d2fc331"} Jul 09 13:58:46.345438 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:46.345407 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:46.345438 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:46.345433 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:46.345631 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:46.345530 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnkjm" podUID="899ea887-23f2-4698-8a03-ebcc2f90c392" Jul 09 13:58:46.345631 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:46.345590 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsfdc" podUID="e88b57b8-05d6-4e3f-9a01-07c5a05a31ee" Jul 09 13:58:46.582273 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:46.582196 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 13:58:46.582721 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:46.582667 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" event={"ID":"8934e636-88e3-45a1-abbc-f86ce7972aaa","Type":"ContainerStarted","Data":"b9bc9ea8c6ca268668c92e53cddf5c58dcf3e3e498de62c79160fdc37df8478e"} Jul 09 13:58:46.585114 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:46.585077 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" event={"ID":"c4c04533-d231-4114-94ac-9cd50a96f6e9","Type":"ContainerStarted","Data":"de450ce1be125c023507d15f50a45d9981474230e9e64e95760e063729f9c0d9"} Jul 09 13:58:46.605225 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:46.605179 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d5mzs" podStartSLOduration=6.592139149 podStartE2EDuration="25.605163567s" totalImagesPullingTime="19.013024418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:45.592489345 +0000 UTC m=+24.769176620" watchObservedRunningTime="2026-07-09 13:58:46.605163567 +0000 UTC m=+25.781850919" Jul 09 13:58:46.605489 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:46.605457 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgt69" podStartSLOduration=4.442724209 podStartE2EDuration="25.605449056s" totalImagesPullingTime="21.162724847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:46.604767832 +0000 UTC m=+25.781455144" watchObservedRunningTime="2026-07-09 13:58:46.605449056 +0000 UTC m=+25.782136347" Jul 09 13:58:47.346149 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:47.346108 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:47.346328 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:47.346241 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7c98" podUID="8ac5555e-e619-4a4f-974a-3597a9455f44" Jul 09 13:58:48.345625 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:48.345596 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:48.346353 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:48.345596 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:48.346353 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:48.345735 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsfdc" podUID="e88b57b8-05d6-4e3f-9a01-07c5a05a31ee" Jul 09 13:58:48.346353 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:48.345831 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnkjm" podUID="899ea887-23f2-4698-8a03-ebcc2f90c392" Jul 09 13:58:48.643933 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:48.643892 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6b4n4" Jul 09 13:58:48.644765 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:48.644747 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6b4n4" Jul 09 13:58:49.345527 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:49.345332 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:49.345768 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:49.345608 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7c98" podUID="8ac5555e-e619-4a4f-974a-3597a9455f44" Jul 09 13:58:49.594094 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:49.594012 2565 generic.go:356] "Generic (PLEG): container finished" podID="31a27df1-dfcb-48d4-aa08-074d2ee3220b" containerID="c7705aef8c829500693c5d0690f33f091526e8d350cb93b3a687d9e7c590cd70" exitCode=0 Jul 09 13:58:49.594262 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:49.594114 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbdq5" event={"ID":"31a27df1-dfcb-48d4-aa08-074d2ee3220b","Type":"ContainerDied","Data":"c7705aef8c829500693c5d0690f33f091526e8d350cb93b3a687d9e7c590cd70"} Jul 09 13:58:49.597811 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:49.597795 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 13:58:49.598210 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:49.598186 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" event={"ID":"8934e636-88e3-45a1-abbc-f86ce7972aaa","Type":"ContainerStarted","Data":"7a67344921e3716ae950e17d988fd5fef5f2f2ee20ffeb9fc0966fd519892910"} Jul 09 13:58:49.598342 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:49.598315 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6b4n4" Jul 09 13:58:49.598690 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:49.598669 2565 scope.go:117] "RemoveContainer" containerID="5a4a7b68246a139b6713fc184a4d51837538cfe465447c65e358337e9d648112" Jul 09 13:58:49.598829 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:49.598813 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6b4n4" Jul 09 13:58:50.346209 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:50.346174 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:50.346747 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:50.346174 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:50.346747 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:50.346307 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnkjm" podUID="899ea887-23f2-4698-8a03-ebcc2f90c392" Jul 09 13:58:50.346747 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:50.346429 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsfdc" podUID="e88b57b8-05d6-4e3f-9a01-07c5a05a31ee" Jul 09 13:58:50.603867 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:50.603849 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 13:58:50.604247 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:50.604220 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" event={"ID":"8934e636-88e3-45a1-abbc-f86ce7972aaa","Type":"ContainerStarted","Data":"afa9f16cc8eececfa4eb52f7ded53e0c2a49a19b2ccd4224ce373542286b031b"} Jul 09 13:58:50.604805 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:50.604769 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:50.604922 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:50.604843 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:50.604922 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:50.604887 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:50.619424 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:50.619401 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:50.619533 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:50.619498 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:58:50.635099 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:50.635053 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" podStartSLOduration=10.543116177 podStartE2EDuration="29.635039272s" totalImagesPullingTime="19.091923095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:50.63473521 +0000 UTC m=+29.811422503" watchObservedRunningTime="2026-07-09 13:58:50.635039272 +0000 UTC m=+29.811726597" Jul 09 13:58:51.145323 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:51.145151 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tsfdc"] Jul 09 13:58:51.145552 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:51.145444 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:51.145552 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:51.145540 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsfdc" podUID="e88b57b8-05d6-4e3f-9a01-07c5a05a31ee" Jul 09 13:58:51.152695 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:51.152670 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hnkjm"] Jul 09 13:58:51.152839 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:51.152768 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:51.152908 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:51.152850 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnkjm" podUID="899ea887-23f2-4698-8a03-ebcc2f90c392" Jul 09 13:58:51.153191 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:51.153169 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q7c98"] Jul 09 13:58:51.153292 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:51.153267 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:51.153369 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:51.153351 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7c98" podUID="8ac5555e-e619-4a4f-974a-3597a9455f44" Jul 09 13:58:51.608287 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:51.608249 2565 generic.go:356] "Generic (PLEG): container finished" podID="31a27df1-dfcb-48d4-aa08-074d2ee3220b" containerID="c478843731a4bcdcc7c0cb847e578f6d30186405b7b50e0bda7d09d921c110fd" exitCode=0 Jul 09 13:58:51.608846 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:51.608319 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbdq5" event={"ID":"31a27df1-dfcb-48d4-aa08-074d2ee3220b","Type":"ContainerDied","Data":"c478843731a4bcdcc7c0cb847e578f6d30186405b7b50e0bda7d09d921c110fd"} Jul 09 13:58:52.346123 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:52.346091 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:52.346123 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:52.346121 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:52.346356 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:52.346221 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsfdc" podUID="e88b57b8-05d6-4e3f-9a01-07c5a05a31ee" Jul 09 13:58:52.346356 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:52.346331 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7c98" podUID="8ac5555e-e619-4a4f-974a-3597a9455f44" Jul 09 13:58:52.454706 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:52.454636 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:58:52.539061 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:52.539016 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:58:52.599589 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:52.599545 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:58:53.345413 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:53.345325 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:53.345994 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:53.345439 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnkjm" podUID="899ea887-23f2-4698-8a03-ebcc2f90c392" Jul 09 13:58:53.614561 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:53.614525 2565 generic.go:356] "Generic (PLEG): container finished" podID="31a27df1-dfcb-48d4-aa08-074d2ee3220b" containerID="9c8fda00b70a59d6d569604f0a106c96aeff1fba321360a785b3f5366885c072" exitCode=0 Jul 09 13:58:53.614735 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:53.614567 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbdq5" event={"ID":"31a27df1-dfcb-48d4-aa08-074d2ee3220b","Type":"ContainerDied","Data":"9c8fda00b70a59d6d569604f0a106c96aeff1fba321360a785b3f5366885c072"} Jul 09 13:58:54.345884 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:54.345854 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:54.346262 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:54.345953 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tsfdc" podUID="e88b57b8-05d6-4e3f-9a01-07c5a05a31ee" Jul 09 13:58:54.346262 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:54.346008 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:54.346262 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:54.346099 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7c98" podUID="8ac5555e-e619-4a4f-974a-3597a9455f44" Jul 09 13:58:54.957000 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:54.956957 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhrmd\" (UniqueName: \"kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd\") pod \"network-check-target-hnkjm\" (UID: \"899ea887-23f2-4698-8a03-ebcc2f90c392\") " pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:54.957185 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:54.957039 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs\") pod \"network-metrics-daemon-q7c98\" (UID: \"8ac5555e-e619-4a4f-974a-3597a9455f44\") " pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:54.957185 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:54.957150 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:58:54.957185 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:54.957179 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:58:54.957347 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:54.957196 2565 projected.go:196] Error preparing data for projected volume kube-api-access-bhrmd for pod openshift-network-diagnostics/network-check-target-hnkjm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:54.957347 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:54.957154 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:54.957347 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:54.957251 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd podName:899ea887-23f2-4698-8a03-ebcc2f90c392 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:26.957232237 +0000 UTC m=+66.133919527 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bhrmd" (UniqueName: "kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd") pod "network-check-target-hnkjm" (UID: "899ea887-23f2-4698-8a03-ebcc2f90c392") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:58:54.957347 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:54.957332 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs podName:8ac5555e-e619-4a4f-974a-3597a9455f44 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:26.957313671 +0000 UTC m=+66.134000954 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs") pod "network-metrics-daemon-q7c98" (UID: "8ac5555e-e619-4a4f-974a-3597a9455f44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:58:55.057846 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:55.057622 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret\") pod \"global-pull-secret-syncer-tsfdc\" (UID: \"e88b57b8-05d6-4e3f-9a01-07c5a05a31ee\") " pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:55.057846 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:55.057803 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:55.058082 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:55.057866 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret podName:e88b57b8-05d6-4e3f-9a01-07c5a05a31ee nodeName:}" failed. No retries permitted until 2026-07-09 13:59:27.057849407 +0000 UTC m=+66.234536678 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret") pod "global-pull-secret-syncer-tsfdc" (UID: "e88b57b8-05d6-4e3f-9a01-07c5a05a31ee") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:58:55.345349 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:55.345272 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:55.345500 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:55.345408 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnkjm" podUID="899ea887-23f2-4698-8a03-ebcc2f90c392" Jul 09 13:58:55.535072 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:55.534899 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:58:55.633476 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:55.633429 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:58:56.158255 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.158224 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-155.ec2.internal" event="NodeReady" Jul 09 13:58:56.158436 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.158382 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 13:58:56.206726 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.206608 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hms6m"] Jul 09 13:58:56.209818 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.209784 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vmr5k"] Jul 09 13:58:56.209957 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.209933 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hms6m" Jul 09 13:58:56.212353 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.212331 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 13:58:56.212473 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.212430 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 13:58:56.212541 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.212490 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 13:58:56.212589 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.212562 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jssv4\"" Jul 09 13:58:56.214099 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.214078 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vmr5k" Jul 09 13:58:56.216519 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.216382 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 13:58:56.216519 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.216396 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 13:58:56.216519 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.216426 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hf6lw\"" Jul 09 13:58:56.219970 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.219617 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hms6m"] Jul 09 13:58:56.220124 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.220076 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vmr5k"] Jul 09 13:58:56.346037 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.346006 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:58:56.346037 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.346036 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:58:56.347225 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.347194 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:58:56.348629 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.348608 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 13:58:56.348937 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.348919 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qwpwr\"" Jul 09 13:58:56.349054 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.348949 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 13:58:56.365380 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.365357 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e38de636-f2c6-43d7-ae27-77d189abfd1a-config-volume\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 13:58:56.365483 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.365399 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxhc2\" (UniqueName: \"kubernetes.io/projected/e38de636-f2c6-43d7-ae27-77d189abfd1a-kube-api-access-xxhc2\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 13:58:56.365483 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.365456 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 13:58:56.365616 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.365549 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0985c40c-9d45-481d-acca-5d55824181c0-cert\") pod \"ingress-canary-hms6m\" (UID: \"0985c40c-9d45-481d-acca-5d55824181c0\") " pod="openshift-ingress-canary/ingress-canary-hms6m" Jul 09 13:58:56.365749 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.365631 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e38de636-f2c6-43d7-ae27-77d189abfd1a-tmp-dir\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 13:58:56.365749 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.365685 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24lgv\" (UniqueName: \"kubernetes.io/projected/0985c40c-9d45-481d-acca-5d55824181c0-kube-api-access-24lgv\") pod \"ingress-canary-hms6m\" (UID: \"0985c40c-9d45-481d-acca-5d55824181c0\") " pod="openshift-ingress-canary/ingress-canary-hms6m" Jul 09 13:58:56.401023 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.400981 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:58:56.467063 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.466985 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0985c40c-9d45-481d-acca-5d55824181c0-cert\") pod \"ingress-canary-hms6m\" (UID: \"0985c40c-9d45-481d-acca-5d55824181c0\") " pod="openshift-ingress-canary/ingress-canary-hms6m" Jul 09 13:58:56.467227 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.467073 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e38de636-f2c6-43d7-ae27-77d189abfd1a-tmp-dir\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 13:58:56.467227 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.467098 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24lgv\" (UniqueName: \"kubernetes.io/projected/0985c40c-9d45-481d-acca-5d55824181c0-kube-api-access-24lgv\") pod \"ingress-canary-hms6m\" (UID: \"0985c40c-9d45-481d-acca-5d55824181c0\") " pod="openshift-ingress-canary/ingress-canary-hms6m" Jul 09 13:58:56.467227 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.467126 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e38de636-f2c6-43d7-ae27-77d189abfd1a-config-volume\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 13:58:56.467385 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.467255 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxhc2\" (UniqueName: \"kubernetes.io/projected/e38de636-f2c6-43d7-ae27-77d189abfd1a-kube-api-access-xxhc2\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 13:58:56.467385 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.467310 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 13:58:56.467484 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:56.467472 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:58:56.467561 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:56.467531 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls podName:e38de636-f2c6-43d7-ae27-77d189abfd1a nodeName:}" failed. No retries permitted until 2026-07-09 13:58:56.967512087 +0000 UTC m=+36.144199360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls") pod "dns-default-vmr5k" (UID: "e38de636-f2c6-43d7-ae27-77d189abfd1a") : secret "dns-default-metrics-tls" not found Jul 09 13:58:56.467561 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.467544 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e38de636-f2c6-43d7-ae27-77d189abfd1a-tmp-dir\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 13:58:56.467722 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.467642 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e38de636-f2c6-43d7-ae27-77d189abfd1a-config-volume\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 13:58:56.471514 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.471492 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0985c40c-9d45-481d-acca-5d55824181c0-cert\") pod \"ingress-canary-hms6m\" (UID: \"0985c40c-9d45-481d-acca-5d55824181c0\") " pod="openshift-ingress-canary/ingress-canary-hms6m" Jul 09 13:58:56.476560 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.476531 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxhc2\" (UniqueName: \"kubernetes.io/projected/e38de636-f2c6-43d7-ae27-77d189abfd1a-kube-api-access-xxhc2\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 13:58:56.477479 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.477459 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24lgv\" (UniqueName: \"kubernetes.io/projected/0985c40c-9d45-481d-acca-5d55824181c0-kube-api-access-24lgv\") pod \"ingress-canary-hms6m\" (UID: \"0985c40c-9d45-481d-acca-5d55824181c0\") " pod="openshift-ingress-canary/ingress-canary-hms6m" Jul 09 13:58:56.524220 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.524188 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hms6m" Jul 09 13:58:56.972070 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:56.972027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 13:58:56.972491 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:56.972178 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:58:56.972491 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:56.972260 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls podName:e38de636-f2c6-43d7-ae27-77d189abfd1a nodeName:}" failed. No retries permitted until 2026-07-09 13:58:57.972236355 +0000 UTC m=+37.148923625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls") pod "dns-default-vmr5k" (UID: "e38de636-f2c6-43d7-ae27-77d189abfd1a") : secret "dns-default-metrics-tls" not found Jul 09 13:58:57.345756 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:57.345677 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:58:57.348902 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:57.348766 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 13:58:57.348902 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:57.348766 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2p5t2\"" Jul 09 13:58:57.348902 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:57.348851 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 13:58:57.981224 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:57.981183 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 13:58:57.981687 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:57.981377 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:58:57.981687 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:57.981464 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls podName:e38de636-f2c6-43d7-ae27-77d189abfd1a nodeName:}" failed. No retries permitted until 2026-07-09 13:58:59.981445565 +0000 UTC m=+39.158132846 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls") pod "dns-default-vmr5k" (UID: "e38de636-f2c6-43d7-ae27-77d189abfd1a") : secret "dns-default-metrics-tls" not found Jul 09 13:58:58.127343 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:58.127316 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hms6m"] Jul 09 13:58:58.131543 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:58:58.131517 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0985c40c_9d45_481d_acca_5d55824181c0.slice/crio-27aecfb80c50084771314dbaa8aa84a73ad32dce088ab616fee810d6ac36b001 WatchSource:0}: Error finding container 27aecfb80c50084771314dbaa8aa84a73ad32dce088ab616fee810d6ac36b001: Status 404 returned error can't find the container with id 27aecfb80c50084771314dbaa8aa84a73ad32dce088ab616fee810d6ac36b001 Jul 09 13:58:58.626484 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:58.626293 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hms6m" event={"ID":"0985c40c-9d45-481d-acca-5d55824181c0","Type":"ContainerStarted","Data":"27aecfb80c50084771314dbaa8aa84a73ad32dce088ab616fee810d6ac36b001"} Jul 09 13:58:58.629155 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:58.629127 2565 generic.go:356] "Generic (PLEG): container finished" podID="31a27df1-dfcb-48d4-aa08-074d2ee3220b" containerID="4eb173e49e072cae5e41d66a184735c0c66a0f214475226c8d206b5856765f23" exitCode=0 Jul 09 13:58:58.629296 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:58.629191 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbdq5" event={"ID":"31a27df1-dfcb-48d4-aa08-074d2ee3220b","Type":"ContainerDied","Data":"4eb173e49e072cae5e41d66a184735c0c66a0f214475226c8d206b5856765f23"} Jul 09 13:58:59.636054 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:59.636018 2565 generic.go:356] "Generic (PLEG): container finished" podID="31a27df1-dfcb-48d4-aa08-074d2ee3220b" containerID="439e3b588665b3c9f927acf51965e30ab135899c01ac6468ee34fcc3b51d3b03" exitCode=0 Jul 09 13:58:59.636514 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:59.636113 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbdq5" event={"ID":"31a27df1-dfcb-48d4-aa08-074d2ee3220b","Type":"ContainerDied","Data":"439e3b588665b3c9f927acf51965e30ab135899c01ac6468ee34fcc3b51d3b03"} Jul 09 13:58:59.998129 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:58:59.998040 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 13:58:59.998305 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:59.998240 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:58:59.998369 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:58:59.998329 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls podName:e38de636-f2c6-43d7-ae27-77d189abfd1a nodeName:}" failed. No retries permitted until 2026-07-09 13:59:03.998305954 +0000 UTC m=+43.174993224 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls") pod "dns-default-vmr5k" (UID: "e38de636-f2c6-43d7-ae27-77d189abfd1a") : secret "dns-default-metrics-tls" not found Jul 09 13:59:00.642371 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:00.642331 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbdq5" event={"ID":"31a27df1-dfcb-48d4-aa08-074d2ee3220b","Type":"ContainerStarted","Data":"7f504e66f5f1203eeb1f8a30b04e4d3516838e8742969498cd3edf396137e1e3"} Jul 09 13:59:00.643918 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:00.643895 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hms6m" event={"ID":"0985c40c-9d45-481d-acca-5d55824181c0","Type":"ContainerStarted","Data":"9fc677b175172c6359a5c6da21a7fbe8608e86ac95732d6a254deff43cb7b586"} Jul 09 13:59:00.665022 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:00.664974 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jbdq5" podStartSLOduration=9.856139683 podStartE2EDuration="39.664959483s" totalImagesPullingTime="29.8088198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:59:00.663322224 +0000 UTC m=+39.840009515" watchObservedRunningTime="2026-07-09 13:59:00.664959483 +0000 UTC m=+39.841646775" Jul 09 13:59:00.679176 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:00.679120 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hms6m" podStartSLOduration=2.342604985 podStartE2EDuration="4.679099254s" totalImagesPullingTime="2.336494269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:59:00.677984905 +0000 UTC m=+39.854672196" watchObservedRunningTime="2026-07-09 13:59:00.679099254 +0000 UTC m=+39.855786547" Jul 09 13:59:00.794025 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:00.793944 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:00.893446 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:00.893393 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:00.951842 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:00.951806 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:01.007370 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:01.007343 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:01.711062 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:01.711024 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:01.781183 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:01.781150 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:04.025999 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:04.025959 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 13:59:04.026364 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:04.026096 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:59:04.026364 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:04.026152 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls podName:e38de636-f2c6-43d7-ae27-77d189abfd1a nodeName:}" failed. No retries permitted until 2026-07-09 13:59:12.026136731 +0000 UTC m=+51.202824015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls") pod "dns-default-vmr5k" (UID: "e38de636-f2c6-43d7-ae27-77d189abfd1a") : secret "dns-default-metrics-tls" not found Jul 09 13:59:12.084574 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:12.084529 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 13:59:12.085076 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:12.084698 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:59:12.085076 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:12.084761 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls podName:e38de636-f2c6-43d7-ae27-77d189abfd1a nodeName:}" failed. No retries permitted until 2026-07-09 13:59:28.084744157 +0000 UTC m=+67.261431426 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls") pod "dns-default-vmr5k" (UID: "e38de636-f2c6-43d7-ae27-77d189abfd1a") : secret "dns-default-metrics-tls" not found Jul 09 13:59:17.512176 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:17.512143 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:17.603388 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:17.603350 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:21.723891 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:21.723856 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:21.790828 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:21.790799 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:21.861779 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:21.861749 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:22.631682 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:22.631640 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-msflv" Jul 09 13:59:22.754801 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:22.754767 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:22.818592 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:22.818563 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:24.622936 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.622904 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-k9gxf"] Jul 09 13:59:24.627687 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.627660 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.629964 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.629939 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 09 13:59:24.630101 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.630030 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 09 13:59:24.630222 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.630207 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 13:59:24.630379 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.630365 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 13:59:24.631355 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.631339 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9bbt8\"" Jul 09 13:59:24.636101 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.636080 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 09 13:59:24.637875 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.637852 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-k9gxf"] Jul 09 13:59:24.672290 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.672262 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d981c93c-f315-4b00-b40c-fa777c2080da-tmp\") pod \"insights-operator-68d9dd94cf-k9gxf\" (UID: \"d981c93c-f315-4b00-b40c-fa777c2080da\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.672416 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.672303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d981c93c-f315-4b00-b40c-fa777c2080da-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-k9gxf\" (UID: \"d981c93c-f315-4b00-b40c-fa777c2080da\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.672416 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.672330 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d981c93c-f315-4b00-b40c-fa777c2080da-snapshots\") pod \"insights-operator-68d9dd94cf-k9gxf\" (UID: \"d981c93c-f315-4b00-b40c-fa777c2080da\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.672416 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.672349 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d981c93c-f315-4b00-b40c-fa777c2080da-serving-cert\") pod \"insights-operator-68d9dd94cf-k9gxf\" (UID: \"d981c93c-f315-4b00-b40c-fa777c2080da\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.672416 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.672389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt6lv\" (UniqueName: \"kubernetes.io/projected/d981c93c-f315-4b00-b40c-fa777c2080da-kube-api-access-kt6lv\") pod \"insights-operator-68d9dd94cf-k9gxf\" (UID: \"d981c93c-f315-4b00-b40c-fa777c2080da\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.672550 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.672464 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d981c93c-f315-4b00-b40c-fa777c2080da-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-k9gxf\" (UID: \"d981c93c-f315-4b00-b40c-fa777c2080da\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.754095 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.754061 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:24.773243 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.773218 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d981c93c-f315-4b00-b40c-fa777c2080da-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-k9gxf\" (UID: \"d981c93c-f315-4b00-b40c-fa777c2080da\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.773356 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.773266 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d981c93c-f315-4b00-b40c-fa777c2080da-tmp\") pod \"insights-operator-68d9dd94cf-k9gxf\" (UID: \"d981c93c-f315-4b00-b40c-fa777c2080da\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.773458 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.773437 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d981c93c-f315-4b00-b40c-fa777c2080da-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-k9gxf\" (UID: \"d981c93c-f315-4b00-b40c-fa777c2080da\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.773528 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.773483 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d981c93c-f315-4b00-b40c-fa777c2080da-snapshots\") pod \"insights-operator-68d9dd94cf-k9gxf\" (UID: \"d981c93c-f315-4b00-b40c-fa777c2080da\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.773528 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.773505 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d981c93c-f315-4b00-b40c-fa777c2080da-serving-cert\") pod \"insights-operator-68d9dd94cf-k9gxf\" (UID: \"d981c93c-f315-4b00-b40c-fa777c2080da\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.773528 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.773522 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt6lv\" (UniqueName: \"kubernetes.io/projected/d981c93c-f315-4b00-b40c-fa777c2080da-kube-api-access-kt6lv\") pod \"insights-operator-68d9dd94cf-k9gxf\" (UID: \"d981c93c-f315-4b00-b40c-fa777c2080da\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.773731 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.773572 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d981c93c-f315-4b00-b40c-fa777c2080da-tmp\") pod \"insights-operator-68d9dd94cf-k9gxf\" (UID: \"d981c93c-f315-4b00-b40c-fa777c2080da\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.774005 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.773983 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d981c93c-f315-4b00-b40c-fa777c2080da-snapshots\") pod \"insights-operator-68d9dd94cf-k9gxf\" (UID: \"d981c93c-f315-4b00-b40c-fa777c2080da\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.774094 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.774056 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d981c93c-f315-4b00-b40c-fa777c2080da-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-k9gxf\" (UID: \"d981c93c-f315-4b00-b40c-fa777c2080da\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.774500 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.774477 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d981c93c-f315-4b00-b40c-fa777c2080da-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-k9gxf\" (UID: \"d981c93c-f315-4b00-b40c-fa777c2080da\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.776818 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.776799 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d981c93c-f315-4b00-b40c-fa777c2080da-serving-cert\") pod \"insights-operator-68d9dd94cf-k9gxf\" (UID: \"d981c93c-f315-4b00-b40c-fa777c2080da\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.781822 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.781800 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt6lv\" (UniqueName: \"kubernetes.io/projected/d981c93c-f315-4b00-b40c-fa777c2080da-kube-api-access-kt6lv\") pod \"insights-operator-68d9dd94cf-k9gxf\" (UID: \"d981c93c-f315-4b00-b40c-fa777c2080da\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:24.823289 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.823239 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:24.936708 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:24.936611 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" Jul 09 13:59:25.054591 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:25.054563 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-k9gxf"] Jul 09 13:59:25.057842 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:59:25.057817 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd981c93c_f315_4b00_b40c_fa777c2080da.slice/crio-f044031ba43650a490fc62a3382f955cef9555bad2a863d629d6fb2d1c77245a WatchSource:0}: Error finding container f044031ba43650a490fc62a3382f955cef9555bad2a863d629d6fb2d1c77245a: Status 404 returned error can't find the container with id f044031ba43650a490fc62a3382f955cef9555bad2a863d629d6fb2d1c77245a Jul 09 13:59:25.707694 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:25.707618 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" event={"ID":"d981c93c-f315-4b00-b40c-fa777c2080da","Type":"ContainerStarted","Data":"f044031ba43650a490fc62a3382f955cef9555bad2a863d629d6fb2d1c77245a"} Jul 09 13:59:26.988507 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:26.988461 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs\") pod \"network-metrics-daemon-q7c98\" (UID: \"8ac5555e-e619-4a4f-974a-3597a9455f44\") " pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 13:59:26.989012 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:26.988640 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhrmd\" (UniqueName: \"kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd\") pod \"network-check-target-hnkjm\" (UID: \"899ea887-23f2-4698-8a03-ebcc2f90c392\") " pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:59:26.991527 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:26.991497 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 13:59:26.991527 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:26.991524 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 13:59:26.998714 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:26.998688 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 13:59:26.998847 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:26.998759 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs podName:8ac5555e-e619-4a4f-974a-3597a9455f44 nodeName:}" failed. No retries permitted until 2026-07-09 14:00:30.998741233 +0000 UTC m=+130.175428508 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs") pod "network-metrics-daemon-q7c98" (UID: "8ac5555e-e619-4a4f-974a-3597a9455f44") : secret "metrics-daemon-secret" not found Jul 09 13:59:27.001181 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:27.001158 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 13:59:27.012033 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:27.011985 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhrmd\" (UniqueName: \"kubernetes.io/projected/899ea887-23f2-4698-8a03-ebcc2f90c392-kube-api-access-bhrmd\") pod \"network-check-target-hnkjm\" (UID: \"899ea887-23f2-4698-8a03-ebcc2f90c392\") " pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:59:27.058699 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:27.058663 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2p5t2\"" Jul 09 13:59:27.066020 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:27.065984 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:59:27.089703 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:27.089677 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret\") pod \"global-pull-secret-syncer-tsfdc\" (UID: \"e88b57b8-05d6-4e3f-9a01-07c5a05a31ee\") " pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:59:27.092767 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:27.092747 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 13:59:27.102198 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:27.102167 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e88b57b8-05d6-4e3f-9a01-07c5a05a31ee-original-pull-secret\") pod \"global-pull-secret-syncer-tsfdc\" (UID: \"e88b57b8-05d6-4e3f-9a01-07c5a05a31ee\") " pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:59:27.219763 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:27.219682 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hnkjm"] Jul 09 13:59:27.224641 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:59:27.224008 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899ea887_23f2_4698_8a03_ebcc2f90c392.slice/crio-cbc46156a96006b0054ef92dc36ad47343916b742d55e62e543f3281ae7293a5 WatchSource:0}: Error finding container cbc46156a96006b0054ef92dc36ad47343916b742d55e62e543f3281ae7293a5: Status 404 returned error can't find the container with id cbc46156a96006b0054ef92dc36ad47343916b742d55e62e543f3281ae7293a5 Jul 09 13:59:27.263383 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:27.263303 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tsfdc" Jul 09 13:59:27.386519 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:27.386492 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tsfdc"] Jul 09 13:59:27.389721 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:59:27.389697 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode88b57b8_05d6_4e3f_9a01_07c5a05a31ee.slice/crio-b58b13cb8b32cc8a89ae4010088fb7f44a1d17f2dac410f19fb3dc899c09d327 WatchSource:0}: Error finding container b58b13cb8b32cc8a89ae4010088fb7f44a1d17f2dac410f19fb3dc899c09d327: Status 404 returned error can't find the container with id b58b13cb8b32cc8a89ae4010088fb7f44a1d17f2dac410f19fb3dc899c09d327 Jul 09 13:59:27.714927 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:27.714889 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tsfdc" event={"ID":"e88b57b8-05d6-4e3f-9a01-07c5a05a31ee","Type":"ContainerStarted","Data":"b58b13cb8b32cc8a89ae4010088fb7f44a1d17f2dac410f19fb3dc899c09d327"} Jul 09 13:59:27.716284 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:27.716252 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hnkjm" event={"ID":"899ea887-23f2-4698-8a03-ebcc2f90c392","Type":"ContainerStarted","Data":"cbc46156a96006b0054ef92dc36ad47343916b742d55e62e543f3281ae7293a5"} Jul 09 13:59:27.718205 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:27.717887 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" event={"ID":"d981c93c-f315-4b00-b40c-fa777c2080da","Type":"ContainerStarted","Data":"7522683d74d7d1c7e7e52204085f78fd464fbe18c48501afdc1843b4d7a2ed09"} Jul 09 13:59:27.735116 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:27.735060 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" podStartSLOduration=1.681750442 podStartE2EDuration="3.735041461s" totalImagesPullingTime="2.053291019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:59:27.733971275 +0000 UTC m=+66.910658568" watchObservedRunningTime="2026-07-09 13:59:27.735041461 +0000 UTC m=+66.911728752" Jul 09 13:59:28.095568 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:28.095479 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 13:59:28.096047 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:28.095673 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:59:28.096047 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:28.095753 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls podName:e38de636-f2c6-43d7-ae27-77d189abfd1a nodeName:}" failed. No retries permitted until 2026-07-09 14:00:00.095730986 +0000 UTC m=+99.272418270 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls") pod "dns-default-vmr5k" (UID: "e38de636-f2c6-43d7-ae27-77d189abfd1a") : secret "dns-default-metrics-tls" not found Jul 09 13:59:30.158616 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.158582 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k2qk9"] Jul 09 13:59:30.180920 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.180858 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k2qk9"] Jul 09 13:59:30.181090 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.180979 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:30.184354 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.184279 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 13:59:30.184539 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.184523 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 13:59:30.184840 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.184794 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cvk42\"" Jul 09 13:59:30.189284 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.189255 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:30.215593 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.215558 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:30.215784 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.215605 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:30.215784 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.215676 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w82g5\" (UniqueName: \"kubernetes.io/projected/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-api-access-w82g5\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:30.215784 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.215703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-data-volume\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:30.215784 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.215724 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-crio-socket\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:30.248965 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.248917 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:30.316827 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.316787 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-crio-socket\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:30.317006 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.316868 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:30.317006 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.316903 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:30.317006 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.316941 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w82g5\" (UniqueName: \"kubernetes.io/projected/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-api-access-w82g5\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:30.317006 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.316944 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-crio-socket\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:30.317006 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.316972 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-data-volume\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:30.317267 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:30.317030 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:59:30.317267 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:30.317050 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:59:30.317267 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:30.317105 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-rbac-proxy-cm podName:d7a5ae4d-48d7-4c8f-8a49-3177053eab12 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:30.817083092 +0000 UTC m=+69.993770375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k2qk9" (UID: "d7a5ae4d-48d7-4c8f-8a49-3177053eab12") : configmap "kube-rbac-proxy" not found Jul 09 13:59:30.317267 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:30.317124 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls podName:d7a5ae4d-48d7-4c8f-8a49-3177053eab12 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:30.817113232 +0000 UTC m=+69.993800508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k2qk9" (UID: "d7a5ae4d-48d7-4c8f-8a49-3177053eab12") : secret "insights-runtime-extractor-tls" not found Jul 09 13:59:30.317469 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.317325 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-data-volume\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:30.326232 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.326207 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w82g5\" (UniqueName: \"kubernetes.io/projected/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-api-access-w82g5\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:30.449565 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.449491 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:30.821859 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.821770 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:30.821859 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:30.821821 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:30.822090 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:30.821949 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:59:30.822090 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:30.822037 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls podName:d7a5ae4d-48d7-4c8f-8a49-3177053eab12 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:31.822008843 +0000 UTC m=+70.998696135 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k2qk9" (UID: "d7a5ae4d-48d7-4c8f-8a49-3177053eab12") : secret "insights-runtime-extractor-tls" not found Jul 09 13:59:30.822090 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:30.822040 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:59:30.822090 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:30.822088 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-rbac-proxy-cm podName:d7a5ae4d-48d7-4c8f-8a49-3177053eab12 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:31.822076585 +0000 UTC m=+70.998763866 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k2qk9" (UID: "d7a5ae4d-48d7-4c8f-8a49-3177053eab12") : configmap "kube-rbac-proxy" not found Jul 09 13:59:31.830103 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:31.830057 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:31.830103 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:31.830111 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:31.830639 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:31.830230 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:59:31.830639 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:31.830290 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-rbac-proxy-cm podName:d7a5ae4d-48d7-4c8f-8a49-3177053eab12 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:33.83026996 +0000 UTC m=+73.006957229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k2qk9" (UID: "d7a5ae4d-48d7-4c8f-8a49-3177053eab12") : configmap "kube-rbac-proxy" not found Jul 09 13:59:31.830639 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:31.830231 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:59:31.830639 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:31.830372 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls podName:d7a5ae4d-48d7-4c8f-8a49-3177053eab12 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:33.830356365 +0000 UTC m=+73.007043636 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k2qk9" (UID: "d7a5ae4d-48d7-4c8f-8a49-3177053eab12") : secret "insights-runtime-extractor-tls" not found Jul 09 13:59:32.130071 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:32.130043 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nq5wm_f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4/dns-node-resolver/0.log" Jul 09 13:59:32.732461 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:32.732423 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tsfdc" event={"ID":"e88b57b8-05d6-4e3f-9a01-07c5a05a31ee","Type":"ContainerStarted","Data":"cda0440c3760fa33ef9a904dd3aba658744453b5e96bc93e07f4d0a9e8ce61fb"} Jul 09 13:59:32.733911 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:32.733889 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hnkjm" event={"ID":"899ea887-23f2-4698-8a03-ebcc2f90c392","Type":"ContainerStarted","Data":"27fcb38002cc6409dc6f6ef8c77585440c08b6afef3c631d2c87465e1d8f87e4"} Jul 09 13:59:32.734038 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:32.734027 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 13:59:32.747474 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:32.747433 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tsfdc" podStartSLOduration=66.928775973 podStartE2EDuration="1m11.747419415s" totalImagesPullingTime="4.818643442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:59:32.746905996 +0000 UTC m=+71.923593288" watchObservedRunningTime="2026-07-09 13:59:32.747419415 +0000 UTC m=+71.924106707" Jul 09 13:59:32.762260 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:32.762216 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hnkjm" podStartSLOduration=66.780797118 podStartE2EDuration="1m11.762202847s" totalImagesPullingTime="4.981405729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:59:32.761156094 +0000 UTC m=+71.937843385" watchObservedRunningTime="2026-07-09 13:59:32.762202847 +0000 UTC m=+71.938890138" Jul 09 13:59:32.929361 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:32.929335 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m6jmd_cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55/node-ca/0.log" Jul 09 13:59:33.729785 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:33.729762 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hms6m_0985c40c-9d45-481d-acca-5d55824181c0/serve-healthcheck-canary/0.log" Jul 09 13:59:33.845590 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:33.845538 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:33.845590 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:33.845593 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:33.845871 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:33.845677 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:59:33.845871 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:33.845681 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:59:33.845871 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:33.845728 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-rbac-proxy-cm podName:d7a5ae4d-48d7-4c8f-8a49-3177053eab12 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:37.845715454 +0000 UTC m=+77.022402723 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k2qk9" (UID: "d7a5ae4d-48d7-4c8f-8a49-3177053eab12") : configmap "kube-rbac-proxy" not found Jul 09 13:59:33.845871 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:33.845742 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls podName:d7a5ae4d-48d7-4c8f-8a49-3177053eab12 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:37.845736297 +0000 UTC m=+77.022423567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k2qk9" (UID: "d7a5ae4d-48d7-4c8f-8a49-3177053eab12") : secret "insights-runtime-extractor-tls" not found Jul 09 13:59:34.552641 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.552608 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fk227"] Jul 09 13:59:34.554802 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.554781 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fk227" Jul 09 13:59:34.557293 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.557272 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 09 13:59:34.558431 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.558415 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7ldfz\"" Jul 09 13:59:34.558532 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.558415 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:59:34.563895 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.563852 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd"] Jul 09 13:59:34.565763 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.565742 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fk227"] Jul 09 13:59:34.565864 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.565827 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd" Jul 09 13:59:34.568205 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.568166 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 13:59:34.568311 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.568237 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-tph7p\"" Jul 09 13:59:34.568311 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.568267 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 13:59:34.568412 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.568180 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 13:59:34.568412 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.568386 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:59:34.576157 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.576137 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd"] Jul 09 13:59:34.651877 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.651837 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/da81d043-359b-4714-af0f-24709dc95f8c-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-2kbkd\" (UID: \"da81d043-359b-4714-af0f-24709dc95f8c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd" Jul 09 13:59:34.651877 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.651875 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgjxn\" (UniqueName: \"kubernetes.io/projected/da81d043-359b-4714-af0f-24709dc95f8c-kube-api-access-fgjxn\") pod \"kube-storage-version-migrator-operator-799cb7f958-2kbkd\" (UID: \"da81d043-359b-4714-af0f-24709dc95f8c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd" Jul 09 13:59:34.652095 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.651901 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9kxg\" (UniqueName: \"kubernetes.io/projected/46b75197-55bf-4f86-9728-c31a882dfeaf-kube-api-access-s9kxg\") pod \"volume-data-source-validator-78495597f6-fk227\" (UID: \"46b75197-55bf-4f86-9728-c31a882dfeaf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fk227" Jul 09 13:59:34.652095 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.651919 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/da81d043-359b-4714-af0f-24709dc95f8c-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-2kbkd\" (UID: \"da81d043-359b-4714-af0f-24709dc95f8c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd" Jul 09 13:59:34.661180 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.661149 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p"] Jul 09 13:59:34.663078 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.663063 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p" Jul 09 13:59:34.665734 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.665715 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 09 13:59:34.665923 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.665905 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bglqp\"" Jul 09 13:59:34.665923 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.665914 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 09 13:59:34.666126 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.665975 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 09 13:59:34.666126 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.665974 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:59:34.667578 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.667558 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr"] Jul 09 13:59:34.669536 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.669456 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr" Jul 09 13:59:34.671952 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.671932 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:59:34.671952 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.671945 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-h96ct\"" Jul 09 13:59:34.672107 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.671963 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 09 13:59:34.673170 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.673147 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 09 13:59:34.673664 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.673633 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p"] Jul 09 13:59:34.680250 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.680230 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr"] Jul 09 13:59:34.752539 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.752503 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/da81d043-359b-4714-af0f-24709dc95f8c-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-2kbkd\" (UID: \"da81d043-359b-4714-af0f-24709dc95f8c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd" Jul 09 13:59:34.752730 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.752552 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2lhn\" (UniqueName: \"kubernetes.io/projected/a1fd29b3-da3d-4685-8b0f-cbb7e7909668-kube-api-access-t2lhn\") pod \"service-ca-operator-7695fc6c8c-tsz9p\" (UID: \"a1fd29b3-da3d-4685-8b0f-cbb7e7909668\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p" Jul 09 13:59:34.752730 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.752610 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1fd29b3-da3d-4685-8b0f-cbb7e7909668-config\") pod \"service-ca-operator-7695fc6c8c-tsz9p\" (UID: \"a1fd29b3-da3d-4685-8b0f-cbb7e7909668\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p" Jul 09 13:59:34.752810 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.752736 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/08db3cf3-5c4e-41f1-b392-1fddf540a42d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-j8jqr\" (UID: \"08db3cf3-5c4e-41f1-b392-1fddf540a42d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr" Jul 09 13:59:34.752810 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.752756 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dmhb\" (UniqueName: \"kubernetes.io/projected/08db3cf3-5c4e-41f1-b392-1fddf540a42d-kube-api-access-7dmhb\") pod \"cluster-samples-operator-65db858894-j8jqr\" (UID: \"08db3cf3-5c4e-41f1-b392-1fddf540a42d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr" Jul 09 13:59:34.752905 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.752880 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/da81d043-359b-4714-af0f-24709dc95f8c-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-2kbkd\" (UID: \"da81d043-359b-4714-af0f-24709dc95f8c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd" Jul 09 13:59:34.752941 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.752915 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgjxn\" (UniqueName: \"kubernetes.io/projected/da81d043-359b-4714-af0f-24709dc95f8c-kube-api-access-fgjxn\") pod \"kube-storage-version-migrator-operator-799cb7f958-2kbkd\" (UID: \"da81d043-359b-4714-af0f-24709dc95f8c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd" Jul 09 13:59:34.752976 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.752954 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1fd29b3-da3d-4685-8b0f-cbb7e7909668-serving-cert\") pod \"service-ca-operator-7695fc6c8c-tsz9p\" (UID: \"a1fd29b3-da3d-4685-8b0f-cbb7e7909668\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p" Jul 09 13:59:34.753007 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.752979 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9kxg\" (UniqueName: \"kubernetes.io/projected/46b75197-55bf-4f86-9728-c31a882dfeaf-kube-api-access-s9kxg\") pod \"volume-data-source-validator-78495597f6-fk227\" (UID: \"46b75197-55bf-4f86-9728-c31a882dfeaf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fk227" Jul 09 13:59:34.753357 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.753336 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/da81d043-359b-4714-af0f-24709dc95f8c-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-2kbkd\" (UID: \"da81d043-359b-4714-af0f-24709dc95f8c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd" Jul 09 13:59:34.754829 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.754811 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/da81d043-359b-4714-af0f-24709dc95f8c-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-2kbkd\" (UID: \"da81d043-359b-4714-af0f-24709dc95f8c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd" Jul 09 13:59:34.761340 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.761311 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgjxn\" (UniqueName: \"kubernetes.io/projected/da81d043-359b-4714-af0f-24709dc95f8c-kube-api-access-fgjxn\") pod \"kube-storage-version-migrator-operator-799cb7f958-2kbkd\" (UID: \"da81d043-359b-4714-af0f-24709dc95f8c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd" Jul 09 13:59:34.761443 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.761402 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9kxg\" (UniqueName: \"kubernetes.io/projected/46b75197-55bf-4f86-9728-c31a882dfeaf-kube-api-access-s9kxg\") pod \"volume-data-source-validator-78495597f6-fk227\" (UID: \"46b75197-55bf-4f86-9728-c31a882dfeaf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fk227" Jul 09 13:59:34.853561 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.853532 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1fd29b3-da3d-4685-8b0f-cbb7e7909668-serving-cert\") pod \"service-ca-operator-7695fc6c8c-tsz9p\" (UID: \"a1fd29b3-da3d-4685-8b0f-cbb7e7909668\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p" Jul 09 13:59:34.853753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.853566 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2lhn\" (UniqueName: \"kubernetes.io/projected/a1fd29b3-da3d-4685-8b0f-cbb7e7909668-kube-api-access-t2lhn\") pod \"service-ca-operator-7695fc6c8c-tsz9p\" (UID: \"a1fd29b3-da3d-4685-8b0f-cbb7e7909668\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p" Jul 09 13:59:34.853753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.853587 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1fd29b3-da3d-4685-8b0f-cbb7e7909668-config\") pod \"service-ca-operator-7695fc6c8c-tsz9p\" (UID: \"a1fd29b3-da3d-4685-8b0f-cbb7e7909668\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p" Jul 09 13:59:34.853753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.853610 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/08db3cf3-5c4e-41f1-b392-1fddf540a42d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-j8jqr\" (UID: \"08db3cf3-5c4e-41f1-b392-1fddf540a42d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr" Jul 09 13:59:34.853753 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.853627 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dmhb\" (UniqueName: \"kubernetes.io/projected/08db3cf3-5c4e-41f1-b392-1fddf540a42d-kube-api-access-7dmhb\") pod \"cluster-samples-operator-65db858894-j8jqr\" (UID: \"08db3cf3-5c4e-41f1-b392-1fddf540a42d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr" Jul 09 13:59:34.854016 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:34.853765 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 13:59:34.854016 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:34.853836 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08db3cf3-5c4e-41f1-b392-1fddf540a42d-samples-operator-tls podName:08db3cf3-5c4e-41f1-b392-1fddf540a42d nodeName:}" failed. No retries permitted until 2026-07-09 13:59:35.353813301 +0000 UTC m=+74.530500577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/08db3cf3-5c4e-41f1-b392-1fddf540a42d-samples-operator-tls") pod "cluster-samples-operator-65db858894-j8jqr" (UID: "08db3cf3-5c4e-41f1-b392-1fddf540a42d") : secret "samples-operator-tls" not found Jul 09 13:59:34.854167 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.854143 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1fd29b3-da3d-4685-8b0f-cbb7e7909668-config\") pod \"service-ca-operator-7695fc6c8c-tsz9p\" (UID: \"a1fd29b3-da3d-4685-8b0f-cbb7e7909668\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p" Jul 09 13:59:34.855864 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.855845 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1fd29b3-da3d-4685-8b0f-cbb7e7909668-serving-cert\") pod \"service-ca-operator-7695fc6c8c-tsz9p\" (UID: \"a1fd29b3-da3d-4685-8b0f-cbb7e7909668\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p" Jul 09 13:59:34.862100 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.862078 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2lhn\" (UniqueName: \"kubernetes.io/projected/a1fd29b3-da3d-4685-8b0f-cbb7e7909668-kube-api-access-t2lhn\") pod \"service-ca-operator-7695fc6c8c-tsz9p\" (UID: \"a1fd29b3-da3d-4685-8b0f-cbb7e7909668\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p" Jul 09 13:59:34.862789 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.862763 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dmhb\" (UniqueName: \"kubernetes.io/projected/08db3cf3-5c4e-41f1-b392-1fddf540a42d-kube-api-access-7dmhb\") pod \"cluster-samples-operator-65db858894-j8jqr\" (UID: \"08db3cf3-5c4e-41f1-b392-1fddf540a42d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr" Jul 09 13:59:34.862871 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.862838 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fk227" Jul 09 13:59:34.874269 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.874238 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd" Jul 09 13:59:34.972275 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:34.972188 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p" Jul 09 13:59:35.003766 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:35.003730 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fk227"] Jul 09 13:59:35.008069 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:59:35.008032 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b75197_55bf_4f86_9728_c31a882dfeaf.slice/crio-1bbc5f131ee2fe055b59fd25a049d15d6790b21b9de4ebe1e43cc3bd2825106f WatchSource:0}: Error finding container 1bbc5f131ee2fe055b59fd25a049d15d6790b21b9de4ebe1e43cc3bd2825106f: Status 404 returned error can't find the container with id 1bbc5f131ee2fe055b59fd25a049d15d6790b21b9de4ebe1e43cc3bd2825106f Jul 09 13:59:35.021775 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:35.021745 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd"] Jul 09 13:59:35.026003 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:59:35.025634 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda81d043_359b_4714_af0f_24709dc95f8c.slice/crio-0f6f8c4df83a962352d5c954b48f40d6861ea3c1ed8e38dc7ba06bca3874b845 WatchSource:0}: Error finding container 0f6f8c4df83a962352d5c954b48f40d6861ea3c1ed8e38dc7ba06bca3874b845: Status 404 returned error can't find the container with id 0f6f8c4df83a962352d5c954b48f40d6861ea3c1ed8e38dc7ba06bca3874b845 Jul 09 13:59:35.106333 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:35.106246 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p"] Jul 09 13:59:35.109019 ip-10-0-136-155 kubenswrapper[2565]: W0709 13:59:35.108998 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1fd29b3_da3d_4685_8b0f_cbb7e7909668.slice/crio-817fa753003c92ae59b484757bdce0390a58f58832c131a6b5d5c7383173eaf5 WatchSource:0}: Error finding container 817fa753003c92ae59b484757bdce0390a58f58832c131a6b5d5c7383173eaf5: Status 404 returned error can't find the container with id 817fa753003c92ae59b484757bdce0390a58f58832c131a6b5d5c7383173eaf5 Jul 09 13:59:35.357506 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:35.357419 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/08db3cf3-5c4e-41f1-b392-1fddf540a42d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-j8jqr\" (UID: \"08db3cf3-5c4e-41f1-b392-1fddf540a42d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr" Jul 09 13:59:35.357666 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:35.357556 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 13:59:35.357666 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:35.357611 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08db3cf3-5c4e-41f1-b392-1fddf540a42d-samples-operator-tls podName:08db3cf3-5c4e-41f1-b392-1fddf540a42d nodeName:}" failed. No retries permitted until 2026-07-09 13:59:36.357593298 +0000 UTC m=+75.534280582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/08db3cf3-5c4e-41f1-b392-1fddf540a42d-samples-operator-tls") pod "cluster-samples-operator-65db858894-j8jqr" (UID: "08db3cf3-5c4e-41f1-b392-1fddf540a42d") : secret "samples-operator-tls" not found Jul 09 13:59:35.742975 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:35.742896 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p" event={"ID":"a1fd29b3-da3d-4685-8b0f-cbb7e7909668","Type":"ContainerStarted","Data":"817fa753003c92ae59b484757bdce0390a58f58832c131a6b5d5c7383173eaf5"} Jul 09 13:59:35.743987 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:35.743962 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fk227" event={"ID":"46b75197-55bf-4f86-9728-c31a882dfeaf","Type":"ContainerStarted","Data":"1bbc5f131ee2fe055b59fd25a049d15d6790b21b9de4ebe1e43cc3bd2825106f"} Jul 09 13:59:35.744889 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:35.744870 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd" event={"ID":"da81d043-359b-4714-af0f-24709dc95f8c","Type":"ContainerStarted","Data":"0f6f8c4df83a962352d5c954b48f40d6861ea3c1ed8e38dc7ba06bca3874b845"} Jul 09 13:59:36.365913 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:36.365881 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/08db3cf3-5c4e-41f1-b392-1fddf540a42d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-j8jqr\" (UID: \"08db3cf3-5c4e-41f1-b392-1fddf540a42d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr" Jul 09 13:59:36.366060 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:36.366020 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 13:59:36.366125 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:36.366090 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08db3cf3-5c4e-41f1-b392-1fddf540a42d-samples-operator-tls podName:08db3cf3-5c4e-41f1-b392-1fddf540a42d nodeName:}" failed. No retries permitted until 2026-07-09 13:59:38.366067259 +0000 UTC m=+77.542754533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/08db3cf3-5c4e-41f1-b392-1fddf540a42d-samples-operator-tls") pod "cluster-samples-operator-65db858894-j8jqr" (UID: "08db3cf3-5c4e-41f1-b392-1fddf540a42d") : secret "samples-operator-tls" not found Jul 09 13:59:36.750794 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:36.750754 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fk227" event={"ID":"46b75197-55bf-4f86-9728-c31a882dfeaf","Type":"ContainerStarted","Data":"37fff89f951110d01d186ceeeba2e5880b1e0598c9aebd115903b4e6c5200256"} Jul 09 13:59:36.768060 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:36.767811 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fk227" podStartSLOduration=1.501990594 podStartE2EDuration="2.767787165s" totalImagesPullingTime="1.265796571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:59:36.767201759 +0000 UTC m=+75.943889053" watchObservedRunningTime="2026-07-09 13:59:36.767787165 +0000 UTC m=+75.944474457" Jul 09 13:59:36.865020 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:36.864980 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:36.923924 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:36.923884 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:37.755920 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:37.755889 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p" event={"ID":"a1fd29b3-da3d-4685-8b0f-cbb7e7909668","Type":"ContainerStarted","Data":"769a69a0c3550e265919a6c20448728f0bb0165919354d9cc091b04072777072"} Jul 09 13:59:37.757488 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:37.757464 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd" event={"ID":"da81d043-359b-4714-af0f-24709dc95f8c","Type":"ContainerStarted","Data":"61800c3ca80cf98c4f3ff3c75182e5b53c35d83262acdb894d2ceebc24dfcf25"} Jul 09 13:59:37.771837 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:37.771571 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p" podStartSLOduration=1.201031736 podStartE2EDuration="3.771552799s" totalImagesPullingTime="2.570521063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:59:37.771147853 +0000 UTC m=+76.947835145" watchObservedRunningTime="2026-07-09 13:59:37.771552799 +0000 UTC m=+76.948240095" Jul 09 13:59:37.785308 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:37.785252 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd" podStartSLOduration=1.13332667 podStartE2EDuration="3.785231992s" totalImagesPullingTime="2.651905322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:59:37.785059279 +0000 UTC m=+76.961746599" watchObservedRunningTime="2026-07-09 13:59:37.785231992 +0000 UTC m=+76.961919285" Jul 09 13:59:37.880330 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:37.880292 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:37.880919 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:37.880894 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:37.881024 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:37.880988 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:59:37.881061 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:37.881055 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls podName:d7a5ae4d-48d7-4c8f-8a49-3177053eab12 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:45.881041405 +0000 UTC m=+85.057728678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k2qk9" (UID: "d7a5ae4d-48d7-4c8f-8a49-3177053eab12") : secret "insights-runtime-extractor-tls" not found Jul 09 13:59:37.881106 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:37.880992 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:59:37.881141 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:37.881111 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-rbac-proxy-cm podName:d7a5ae4d-48d7-4c8f-8a49-3177053eab12 nodeName:}" failed. No retries permitted until 2026-07-09 13:59:45.881100523 +0000 UTC m=+85.057787793 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k2qk9" (UID: "d7a5ae4d-48d7-4c8f-8a49-3177053eab12") : configmap "kube-rbac-proxy" not found Jul 09 13:59:38.389370 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:38.389326 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/08db3cf3-5c4e-41f1-b392-1fddf540a42d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-j8jqr\" (UID: \"08db3cf3-5c4e-41f1-b392-1fddf540a42d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr" Jul 09 13:59:38.389552 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:38.389518 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 13:59:38.389614 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:38.389602 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08db3cf3-5c4e-41f1-b392-1fddf540a42d-samples-operator-tls podName:08db3cf3-5c4e-41f1-b392-1fddf540a42d nodeName:}" failed. No retries permitted until 2026-07-09 13:59:42.389580932 +0000 UTC m=+81.566268215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/08db3cf3-5c4e-41f1-b392-1fddf540a42d-samples-operator-tls") pod "cluster-samples-operator-65db858894-j8jqr" (UID: "08db3cf3-5c4e-41f1-b392-1fddf540a42d") : secret "samples-operator-tls" not found Jul 09 13:59:38.975506 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:38.975468 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:39.058904 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:39.058871 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:39.120461 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:39.120437 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:39.396003 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:39.395972 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:39.659329 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:39.659257 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:39.759704 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:39.759670 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:41.296258 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:41.296219 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:41.352715 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:41.352686 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:41.790943 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:41.790914 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:41.892809 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:41.892780 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:42.420148 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:42.420106 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/08db3cf3-5c4e-41f1-b392-1fddf540a42d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-j8jqr\" (UID: \"08db3cf3-5c4e-41f1-b392-1fddf540a42d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr" Jul 09 13:59:42.420547 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:42.420256 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 13:59:42.420547 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:42.420320 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08db3cf3-5c4e-41f1-b392-1fddf540a42d-samples-operator-tls podName:08db3cf3-5c4e-41f1-b392-1fddf540a42d nodeName:}" failed. No retries permitted until 2026-07-09 13:59:50.420303522 +0000 UTC m=+89.596990796 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/08db3cf3-5c4e-41f1-b392-1fddf540a42d-samples-operator-tls") pod "cluster-samples-operator-65db858894-j8jqr" (UID: "08db3cf3-5c4e-41f1-b392-1fddf540a42d") : secret "samples-operator-tls" not found Jul 09 13:59:42.594511 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:42.594478 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:43.318503 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:43.318389 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:45.319837 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:45.319802 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:45.488825 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:45.488794 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:45.589796 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:45.589714 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:45.687945 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:45.687916 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:45.789014 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:45.788984 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:45.947875 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:45.947842 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:45.948038 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:45.947881 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:45.948038 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:45.947993 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:59:45.948115 ip-10-0-136-155 kubenswrapper[2565]: E0709 13:59:45.948062 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls podName:d7a5ae4d-48d7-4c8f-8a49-3177053eab12 nodeName:}" failed. No retries permitted until 2026-07-09 14:00:01.948046823 +0000 UTC m=+101.124734093 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k2qk9" (UID: "d7a5ae4d-48d7-4c8f-8a49-3177053eab12") : secret "insights-runtime-extractor-tls" not found Jul 09 13:59:45.948360 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:45.948344 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 13:59:45.949681 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:45.949659 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:46.052990 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:46.052950 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:46.816122 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:46.816095 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:47.092336 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:47.092261 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:47.415620 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:47.415594 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:47.612794 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:47.612740 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:48.020128 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:48.020098 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:48.212738 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:48.212703 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:48.616064 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:48.616029 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:48.804303 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:48.804277 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:48.935838 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:48.935766 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:49.036461 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:49.036429 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:49.411977 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:49.411946 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:49.778956 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:49.778844 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:49.876343 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:49.876311 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:50.226447 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:50.226415 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:50.483734 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:50.483660 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/08db3cf3-5c4e-41f1-b392-1fddf540a42d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-j8jqr\" (UID: \"08db3cf3-5c4e-41f1-b392-1fddf540a42d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr" Jul 09 13:59:50.485879 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:50.485857 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/08db3cf3-5c4e-41f1-b392-1fddf540a42d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-j8jqr\" (UID: \"08db3cf3-5c4e-41f1-b392-1fddf540a42d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr" Jul 09 13:59:50.580119 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:50.580082 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr" Jul 09 13:59:50.702948 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:50.702799 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr"] Jul 09 13:59:50.799220 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:50.799181 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr" event={"ID":"08db3cf3-5c4e-41f1-b392-1fddf540a42d","Type":"ContainerStarted","Data":"607cd008589ec5e23336a1acb1f2d8e9292f165f9eef1abff5e0ba02f98b74cc"} Jul 09 13:59:50.817823 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:50.817786 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:51.212142 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:51.212102 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:51.606850 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:51.606812 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:51.659616 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:51.659580 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:52.015569 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:52.015507 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:52.416257 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:52.416216 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:52.474113 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:52.474087 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:52.806992 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:52.806897 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr" event={"ID":"08db3cf3-5c4e-41f1-b392-1fddf540a42d","Type":"ContainerStarted","Data":"27a59db8904a1a38111bd71c6971c036f7ace68cd26503686a98b188ffffe7ac"} Jul 09 13:59:52.806992 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:52.806952 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr" event={"ID":"08db3cf3-5c4e-41f1-b392-1fddf540a42d","Type":"ContainerStarted","Data":"cd25afd60d53d663aeed9542a2232c86c8c575d45106356bb51828b6fdde220d"} Jul 09 13:59:52.812892 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:52.812868 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:52.823560 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:52.823521 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j8jqr" podStartSLOduration=17.099397199 podStartE2EDuration="18.823508281s" totalImagesPullingTime="1.724111082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:59:52.822823492 +0000 UTC m=+91.999510784" watchObservedRunningTime="2026-07-09 13:59:52.823508281 +0000 UTC m=+92.000195569" Jul 09 13:59:53.052008 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:53.051980 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:53.417695 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:53.417641 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:54.214549 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:54.214515 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:54.451003 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:54.450972 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:54.817294 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:54.817260 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:55.038575 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:55.038542 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:55.430678 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:55.430356 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:55.617895 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:55.617862 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:56.020077 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:56.020046 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:59.080232 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:59.080201 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:59.144017 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:59.143980 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:59.233111 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:59.233082 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 13:59:59.473489 ip-10-0-136-155 kubenswrapper[2565]: I0709 13:59:59.473453 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:00.157157 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.157126 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 14:00:00.159336 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.159305 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e38de636-f2c6-43d7-ae27-77d189abfd1a-metrics-tls\") pod \"dns-default-vmr5k\" (UID: \"e38de636-f2c6-43d7-ae27-77d189abfd1a\") " pod="openshift-dns/dns-default-vmr5k" Jul 09 14:00:00.361960 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.361924 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74f69f777d-w52q2"] Jul 09 14:00:00.364535 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.364518 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74f69f777d-w52q2" Jul 09 14:00:00.368323 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.368298 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 14:00:00.368323 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.368305 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 14:00:00.368540 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.368362 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-9pf29\"" Jul 09 14:00:00.368540 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.368305 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 09 14:00:00.368540 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.368393 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 14:00:00.373155 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.373135 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh"] Jul 09 14:00:00.374894 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.374880 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.376763 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.376742 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74f69f777d-w52q2"] Jul 09 14:00:00.377897 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.377880 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 09 14:00:00.377991 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.377883 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 09 14:00:00.377991 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.377883 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 09 14:00:00.377991 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.377931 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 09 14:00:00.392911 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.392886 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh"] Jul 09 14:00:00.433004 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.432924 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hf6lw\"" Jul 09 14:00:00.441221 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.441194 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vmr5k" Jul 09 14:00:00.446119 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.446100 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66f555bfb6-m7pzn"] Jul 09 14:00:00.447907 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.447892 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.450582 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.450560 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 14:00:00.450737 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.450561 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n8xtq\"" Jul 09 14:00:00.450835 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.450811 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 14:00:00.450921 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.450904 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 14:00:00.456768 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.456746 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 14:00:00.460263 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.460241 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skqbf\" (UniqueName: \"kubernetes.io/projected/6eb9868d-e0d8-4893-88df-8e20d87ecaf6-kube-api-access-skqbf\") pod \"managed-serviceaccount-addon-agent-74f69f777d-w52q2\" (UID: \"6eb9868d-e0d8-4893-88df-8e20d87ecaf6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74f69f777d-w52q2" Jul 09 14:00:00.460400 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.460301 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c23a52e1-6e35-4469-b441-7ad144a6acfa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74c47f88b5-68jgh\" (UID: \"c23a52e1-6e35-4469-b441-7ad144a6acfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.460400 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.460334 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c23a52e1-6e35-4469-b441-7ad144a6acfa-hub\") pod \"cluster-proxy-proxy-agent-74c47f88b5-68jgh\" (UID: \"c23a52e1-6e35-4469-b441-7ad144a6acfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.460513 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.460425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c23a52e1-6e35-4469-b441-7ad144a6acfa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74c47f88b5-68jgh\" (UID: \"c23a52e1-6e35-4469-b441-7ad144a6acfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.460513 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.460469 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c23a52e1-6e35-4469-b441-7ad144a6acfa-ca\") pod \"cluster-proxy-proxy-agent-74c47f88b5-68jgh\" (UID: \"c23a52e1-6e35-4469-b441-7ad144a6acfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.460513 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.460497 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6eb9868d-e0d8-4893-88df-8e20d87ecaf6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74f69f777d-w52q2\" (UID: \"6eb9868d-e0d8-4893-88df-8e20d87ecaf6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74f69f777d-w52q2" Jul 09 14:00:00.460712 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.460518 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c23a52e1-6e35-4469-b441-7ad144a6acfa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74c47f88b5-68jgh\" (UID: \"c23a52e1-6e35-4469-b441-7ad144a6acfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.460712 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.460588 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv5df\" (UniqueName: \"kubernetes.io/projected/c23a52e1-6e35-4469-b441-7ad144a6acfa-kube-api-access-wv5df\") pod \"cluster-proxy-proxy-agent-74c47f88b5-68jgh\" (UID: \"c23a52e1-6e35-4469-b441-7ad144a6acfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.463669 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.463623 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66f555bfb6-m7pzn"] Jul 09 14:00:00.519553 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.519524 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:00.561507 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.561475 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c23a52e1-6e35-4469-b441-7ad144a6acfa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74c47f88b5-68jgh\" (UID: \"c23a52e1-6e35-4469-b441-7ad144a6acfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.561639 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.561514 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-installation-pull-secrets\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.561639 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.561546 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-ca-trust-extracted\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.561759 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.561674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c23a52e1-6e35-4469-b441-7ad144a6acfa-hub\") pod \"cluster-proxy-proxy-agent-74c47f88b5-68jgh\" (UID: \"c23a52e1-6e35-4469-b441-7ad144a6acfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.561759 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.561708 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwx2b\" (UniqueName: \"kubernetes.io/projected/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-kube-api-access-cwx2b\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.561834 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.561764 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c23a52e1-6e35-4469-b441-7ad144a6acfa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74c47f88b5-68jgh\" (UID: \"c23a52e1-6e35-4469-b441-7ad144a6acfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.561834 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.561805 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c23a52e1-6e35-4469-b441-7ad144a6acfa-ca\") pod \"cluster-proxy-proxy-agent-74c47f88b5-68jgh\" (UID: \"c23a52e1-6e35-4469-b441-7ad144a6acfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.561911 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.561845 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6eb9868d-e0d8-4893-88df-8e20d87ecaf6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74f69f777d-w52q2\" (UID: \"6eb9868d-e0d8-4893-88df-8e20d87ecaf6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74f69f777d-w52q2" Jul 09 14:00:00.561911 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.561870 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-registry-certificates\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.561911 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.561900 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-trusted-ca\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.562044 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.561928 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c23a52e1-6e35-4469-b441-7ad144a6acfa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74c47f88b5-68jgh\" (UID: \"c23a52e1-6e35-4469-b441-7ad144a6acfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.562044 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.561950 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-bound-sa-token\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.562044 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.562011 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv5df\" (UniqueName: \"kubernetes.io/projected/c23a52e1-6e35-4469-b441-7ad144a6acfa-kube-api-access-wv5df\") pod \"cluster-proxy-proxy-agent-74c47f88b5-68jgh\" (UID: \"c23a52e1-6e35-4469-b441-7ad144a6acfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.562202 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.562096 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skqbf\" (UniqueName: \"kubernetes.io/projected/6eb9868d-e0d8-4893-88df-8e20d87ecaf6-kube-api-access-skqbf\") pod \"managed-serviceaccount-addon-agent-74f69f777d-w52q2\" (UID: \"6eb9868d-e0d8-4893-88df-8e20d87ecaf6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74f69f777d-w52q2" Jul 09 14:00:00.562202 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.562127 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-image-registry-private-configuration\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.562202 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.562153 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-registry-tls\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.562627 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.562595 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c23a52e1-6e35-4469-b441-7ad144a6acfa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74c47f88b5-68jgh\" (UID: \"c23a52e1-6e35-4469-b441-7ad144a6acfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.564293 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.564268 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c23a52e1-6e35-4469-b441-7ad144a6acfa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74c47f88b5-68jgh\" (UID: \"c23a52e1-6e35-4469-b441-7ad144a6acfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.564511 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.564493 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c23a52e1-6e35-4469-b441-7ad144a6acfa-hub\") pod \"cluster-proxy-proxy-agent-74c47f88b5-68jgh\" (UID: \"c23a52e1-6e35-4469-b441-7ad144a6acfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.564592 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.564563 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c23a52e1-6e35-4469-b441-7ad144a6acfa-ca\") pod \"cluster-proxy-proxy-agent-74c47f88b5-68jgh\" (UID: \"c23a52e1-6e35-4469-b441-7ad144a6acfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.564724 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.564706 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6eb9868d-e0d8-4893-88df-8e20d87ecaf6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74f69f777d-w52q2\" (UID: \"6eb9868d-e0d8-4893-88df-8e20d87ecaf6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74f69f777d-w52q2" Jul 09 14:00:00.564799 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.564783 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c23a52e1-6e35-4469-b441-7ad144a6acfa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74c47f88b5-68jgh\" (UID: \"c23a52e1-6e35-4469-b441-7ad144a6acfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.571869 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.571846 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skqbf\" (UniqueName: \"kubernetes.io/projected/6eb9868d-e0d8-4893-88df-8e20d87ecaf6-kube-api-access-skqbf\") pod \"managed-serviceaccount-addon-agent-74f69f777d-w52q2\" (UID: \"6eb9868d-e0d8-4893-88df-8e20d87ecaf6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74f69f777d-w52q2" Jul 09 14:00:00.572220 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.572193 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv5df\" (UniqueName: \"kubernetes.io/projected/c23a52e1-6e35-4469-b441-7ad144a6acfa-kube-api-access-wv5df\") pod \"cluster-proxy-proxy-agent-74c47f88b5-68jgh\" (UID: \"c23a52e1-6e35-4469-b441-7ad144a6acfa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.587951 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.587928 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vmr5k"] Jul 09 14:00:00.591829 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:00:00.591806 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode38de636_f2c6_43d7_ae27_77d189abfd1a.slice/crio-b5d98152feba839624839b734fd3ed040d64d982a61d6499860e82efeb4aa65f WatchSource:0}: Error finding container b5d98152feba839624839b734fd3ed040d64d982a61d6499860e82efeb4aa65f: Status 404 returned error can't find the container with id b5d98152feba839624839b734fd3ed040d64d982a61d6499860e82efeb4aa65f Jul 09 14:00:00.591919 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.591872 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:00.663403 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.663360 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-image-registry-private-configuration\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.663403 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.663406 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-registry-tls\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.663633 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.663441 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-installation-pull-secrets\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.663633 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.663458 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-ca-trust-extracted\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.663633 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.663480 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwx2b\" (UniqueName: \"kubernetes.io/projected/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-kube-api-access-cwx2b\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.663633 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.663537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-registry-certificates\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.663633 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.663557 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-trusted-ca\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.663633 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.663581 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-bound-sa-token\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.664016 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.663982 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-ca-trust-extracted\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.664700 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.664671 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-registry-certificates\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.664793 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.664739 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-trusted-ca\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.665846 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.665823 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-image-registry-private-configuration\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.665938 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.665844 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-installation-pull-secrets\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.665938 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.665932 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-registry-tls\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.673048 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.673020 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-bound-sa-token\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.673175 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.673159 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwx2b\" (UniqueName: \"kubernetes.io/projected/5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b-kube-api-access-cwx2b\") pod \"image-registry-66f555bfb6-m7pzn\" (UID: \"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b\") " pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.693094 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.693013 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74f69f777d-w52q2" Jul 09 14:00:00.700923 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.700904 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" Jul 09 14:00:00.781112 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.781083 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:00.834056 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.833858 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74f69f777d-w52q2"] Jul 09 14:00:00.834975 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.834944 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vmr5k" event={"ID":"e38de636-f2c6-43d7-ae27-77d189abfd1a","Type":"ContainerStarted","Data":"b5d98152feba839624839b734fd3ed040d64d982a61d6499860e82efeb4aa65f"} Jul 09 14:00:00.836725 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:00:00.836694 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6eb9868d_e0d8_4893_88df_8e20d87ecaf6.slice/crio-b96f221cf265897da6d7458fd62005bda22aa9271154e1f0bff026087d87ed35 WatchSource:0}: Error finding container b96f221cf265897da6d7458fd62005bda22aa9271154e1f0bff026087d87ed35: Status 404 returned error can't find the container with id b96f221cf265897da6d7458fd62005bda22aa9271154e1f0bff026087d87ed35 Jul 09 14:00:00.853355 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.853328 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh"] Jul 09 14:00:00.855637 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:00:00.855611 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc23a52e1_6e35_4469_b441_7ad144a6acfa.slice/crio-714bddeb67d00aad2c8050584e9889747f8ea660db406bd59658eb6274bdb6ef WatchSource:0}: Error finding container 714bddeb67d00aad2c8050584e9889747f8ea660db406bd59658eb6274bdb6ef: Status 404 returned error can't find the container with id 714bddeb67d00aad2c8050584e9889747f8ea660db406bd59658eb6274bdb6ef Jul 09 14:00:00.914665 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:00.914621 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66f555bfb6-m7pzn"] Jul 09 14:00:00.918375 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:00:00.918344 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed2dfcd_b9e9_4821_b71b_11c0c7dcfc0b.slice/crio-b7f660b71e59e7f6907fa9b983ed4de4c2b9a99ea6cb682010b52e4719fe3831 WatchSource:0}: Error finding container b7f660b71e59e7f6907fa9b983ed4de4c2b9a99ea6cb682010b52e4719fe3831: Status 404 returned error can't find the container with id b7f660b71e59e7f6907fa9b983ed4de4c2b9a99ea6cb682010b52e4719fe3831 Jul 09 14:00:01.840191 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:01.840141 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" event={"ID":"c23a52e1-6e35-4469-b441-7ad144a6acfa","Type":"ContainerStarted","Data":"714bddeb67d00aad2c8050584e9889747f8ea660db406bd59658eb6274bdb6ef"} Jul 09 14:00:01.841512 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:01.841483 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74f69f777d-w52q2" event={"ID":"6eb9868d-e0d8-4893-88df-8e20d87ecaf6","Type":"ContainerStarted","Data":"b96f221cf265897da6d7458fd62005bda22aa9271154e1f0bff026087d87ed35"} Jul 09 14:00:01.843185 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:01.843158 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" event={"ID":"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b","Type":"ContainerStarted","Data":"b6a75ecc842d0691937620553dbf973a26e25a8beffbe8ec0a0109cbc3e0edd9"} Jul 09 14:00:01.843326 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:01.843211 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" event={"ID":"5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b","Type":"ContainerStarted","Data":"b7f660b71e59e7f6907fa9b983ed4de4c2b9a99ea6cb682010b52e4719fe3831"} Jul 09 14:00:01.843326 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:01.843272 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:01.866107 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:01.866048 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" podStartSLOduration=1.866025353 podStartE2EDuration="1.866025353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:01.86501783 +0000 UTC m=+101.041705122" watchObservedRunningTime="2026-07-09 14:00:01.866025353 +0000 UTC m=+101.042712630" Jul 09 14:00:01.975684 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:01.975628 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 14:00:01.978305 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:01.978283 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7a5ae4d-48d7-4c8f-8a49-3177053eab12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k2qk9\" (UID: \"d7a5ae4d-48d7-4c8f-8a49-3177053eab12\") " pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 14:00:01.993792 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:01.993765 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k2qk9" Jul 09 14:00:02.258628 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:02.258574 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k2qk9"] Jul 09 14:00:02.261901 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:00:02.261874 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a5ae4d_48d7_4c8f_8a49_3177053eab12.slice/crio-e1022494fb0fbaadc08c1c137f610bc7c61fd1382255aa7ba5a20fcf33dee26f WatchSource:0}: Error finding container e1022494fb0fbaadc08c1c137f610bc7c61fd1382255aa7ba5a20fcf33dee26f: Status 404 returned error can't find the container with id e1022494fb0fbaadc08c1c137f610bc7c61fd1382255aa7ba5a20fcf33dee26f Jul 09 14:00:02.850031 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:02.849179 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vmr5k" event={"ID":"e38de636-f2c6-43d7-ae27-77d189abfd1a","Type":"ContainerStarted","Data":"a95b4ea5855c70e7066788e8d359f03ddad181cc3e4b3a52b7450ee6c33f47f4"} Jul 09 14:00:02.850031 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:02.849245 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vmr5k" event={"ID":"e38de636-f2c6-43d7-ae27-77d189abfd1a","Type":"ContainerStarted","Data":"b10f1c446243c4fb51ba49691703803b9da8e06bf0e5b6650d25bf7128bdbcc1"} Jul 09 14:00:02.850031 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:02.849968 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vmr5k" Jul 09 14:00:02.851589 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:02.851551 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k2qk9" event={"ID":"d7a5ae4d-48d7-4c8f-8a49-3177053eab12","Type":"ContainerStarted","Data":"e1022494fb0fbaadc08c1c137f610bc7c61fd1382255aa7ba5a20fcf33dee26f"} Jul 09 14:00:02.866317 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:02.866270 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vmr5k" podStartSLOduration=65.307958512 podStartE2EDuration="1m6.866249142s" totalImagesPullingTime="1.55829063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:02.866127301 +0000 UTC m=+102.042814595" watchObservedRunningTime="2026-07-09 14:00:02.866249142 +0000 UTC m=+102.042936436" Jul 09 14:00:03.739014 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:03.738981 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hnkjm" Jul 09 14:00:03.877582 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:03.877527 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:03.978183 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:03.978149 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:04.622251 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:04.622206 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:04.726428 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:04.726382 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:07.448991 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:07.448954 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:07.504150 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:07.504094 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:07.872556 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:07.872520 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k2qk9" event={"ID":"d7a5ae4d-48d7-4c8f-8a49-3177053eab12","Type":"ContainerStarted","Data":"e600c4e1d464a3ada56d4165a5813ed4cea811ec3d564f324ac2d7e0fd7a10ad"} Jul 09 14:00:10.187345 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:10.187314 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:10.884627 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:10.884589 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" event={"ID":"c23a52e1-6e35-4469-b441-7ad144a6acfa","Type":"ContainerStarted","Data":"2e3cc9e8ee5f175304ac9308d6ab57b4a9838d5e73360c000c587fbd35eb7be2"} Jul 09 14:00:10.884829 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:10.884635 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" event={"ID":"c23a52e1-6e35-4469-b441-7ad144a6acfa","Type":"ContainerStarted","Data":"5a13cca369d03b08711be64109842fd7bbef630759d375225997ddbc106bd9b8"} Jul 09 14:00:10.884829 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:10.884672 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" event={"ID":"c23a52e1-6e35-4469-b441-7ad144a6acfa","Type":"ContainerStarted","Data":"9f7fcdf572bee3eb86d2d7273e060b350ca79a4b366d58ae00828c54934456e3"} Jul 09 14:00:10.886152 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:10.886123 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74f69f777d-w52q2" event={"ID":"6eb9868d-e0d8-4893-88df-8e20d87ecaf6","Type":"ContainerStarted","Data":"f9ad5c4fcfa47c55dc07fbc084e305e77668fa3687c1ae79864cf17683d5a363"} Jul 09 14:00:10.887762 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:10.887743 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k2qk9" event={"ID":"d7a5ae4d-48d7-4c8f-8a49-3177053eab12","Type":"ContainerStarted","Data":"6f7da8b73e007c1e5a30ca81a5e22b9892abd44caa52e6488dd912215d93081e"} Jul 09 14:00:10.904090 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:10.904044 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74c47f88b5-68jgh" podStartSLOduration=1.6125378179999998 podStartE2EDuration="10.904031104s" totalImagesPullingTime="9.291493286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:10.902779996 +0000 UTC m=+110.079467288" watchObservedRunningTime="2026-07-09 14:00:10.904031104 +0000 UTC m=+110.080718396" Jul 09 14:00:10.916703 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:10.916635 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74f69f777d-w52q2" podStartSLOduration=1.6070551100000001 podStartE2EDuration="10.91661979s" totalImagesPullingTime="9.30956468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:10.916578462 +0000 UTC m=+110.093265748" watchObservedRunningTime="2026-07-09 14:00:10.91661979 +0000 UTC m=+110.093307082" Jul 09 14:00:12.474474 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.474432 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:12.577133 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.577089 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:12.668775 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.668738 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:12.703548 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.703511 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-57jrl"] Jul 09 14:00:12.713291 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.713257 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.716316 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.716294 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 14:00:12.716621 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.716600 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 14:00:12.717897 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.717705 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ndd5r\"" Jul 09 14:00:12.717897 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.717773 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 14:00:12.717897 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.717788 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 14:00:12.717897 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.717823 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 14:00:12.717897 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.717880 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 14:00:12.776766 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.776670 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:12.882753 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.882714 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-textfile\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.882906 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.882765 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-wtmp\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.882906 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.882790 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85a5f10b-677b-4651-929e-4fe3e29425cc-root\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.882906 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.882866 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.882906 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.882891 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-tls\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.883029 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.882913 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85a5f10b-677b-4651-929e-4fe3e29425cc-sys\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.883029 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.882928 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a5f10b-677b-4651-929e-4fe3e29425cc-metrics-client-ca\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.883029 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.882962 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.883029 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.882994 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrhlj\" (UniqueName: \"kubernetes.io/projected/85a5f10b-677b-4651-929e-4fe3e29425cc-kube-api-access-qrhlj\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.983513 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.983486 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.983686 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.983518 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-tls\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.983686 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.983541 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85a5f10b-677b-4651-929e-4fe3e29425cc-sys\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.983686 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.983556 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a5f10b-677b-4651-929e-4fe3e29425cc-metrics-client-ca\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.983686 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.983596 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.983686 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.983619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrhlj\" (UniqueName: \"kubernetes.io/projected/85a5f10b-677b-4651-929e-4fe3e29425cc-kube-api-access-qrhlj\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.983686 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.983624 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85a5f10b-677b-4651-929e-4fe3e29425cc-sys\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.983686 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.983663 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-textfile\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.983686 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:00:12.983676 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 14:00:12.984132 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.983699 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-wtmp\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.984132 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.983724 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85a5f10b-677b-4651-929e-4fe3e29425cc-root\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.984132 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:00:12.983782 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-tls podName:85a5f10b-677b-4651-929e-4fe3e29425cc nodeName:}" failed. No retries permitted until 2026-07-09 14:00:13.483762128 +0000 UTC m=+112.660449404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-tls") pod "node-exporter-57jrl" (UID: "85a5f10b-677b-4651-929e-4fe3e29425cc") : secret "node-exporter-tls" not found Jul 09 14:00:12.984132 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.983841 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85a5f10b-677b-4651-929e-4fe3e29425cc-root\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.984132 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.983886 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-wtmp\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.984132 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.984013 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-textfile\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.984355 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.984183 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a5f10b-677b-4651-929e-4fe3e29425cc-metrics-client-ca\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.984355 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.984187 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.985759 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.985742 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:12.992274 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:12.992252 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrhlj\" (UniqueName: \"kubernetes.io/projected/85a5f10b-677b-4651-929e-4fe3e29425cc-kube-api-access-qrhlj\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:13.447785 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:13.447752 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:13.489023 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:13.488996 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-tls\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:13.489346 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:00:13.489146 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 14:00:13.489346 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:00:13.489205 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-tls podName:85a5f10b-677b-4651-929e-4fe3e29425cc nodeName:}" failed. No retries permitted until 2026-07-09 14:00:14.489189563 +0000 UTC m=+113.665876833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-tls") pod "node-exporter-57jrl" (UID: "85a5f10b-677b-4651-929e-4fe3e29425cc") : secret "node-exporter-tls" not found Jul 09 14:00:13.550550 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:13.550519 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:13.646744 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:13.646710 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:13.717124 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:13.717041 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:13.784314 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:13.784284 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:13.862276 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:13.862249 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vmr5k" Jul 09 14:00:13.899337 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:13.899300 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k2qk9" event={"ID":"d7a5ae4d-48d7-4c8f-8a49-3177053eab12","Type":"ContainerStarted","Data":"8608c1e47ab8fc65fa03da79e7435883bdfacd313ec3d9d2f563d49adc789acc"} Jul 09 14:00:13.924162 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:13.924110 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k2qk9" podStartSLOduration=33.50359768 podStartE2EDuration="43.924092527s" totalImagesPullingTime="10.420494847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:59:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:13.923153839 +0000 UTC m=+113.099841132" watchObservedRunningTime="2026-07-09 14:00:13.924092527 +0000 UTC m=+113.100779819" Jul 09 14:00:13.966792 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:13.966755 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:14.496949 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:14.496903 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-tls\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:14.499169 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:14.499150 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85a5f10b-677b-4651-929e-4fe3e29425cc-node-exporter-tls\") pod \"node-exporter-57jrl\" (UID: \"85a5f10b-677b-4651-929e-4fe3e29425cc\") " pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:14.525239 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:14.525214 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-57jrl" Jul 09 14:00:14.535220 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:00:14.535197 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a5f10b_677b_4651_929e_4fe3e29425cc.slice/crio-9d5cb772403424fce548903eeb1f33a57f8fac92a8f9b6f5ae3051ac88b1643f WatchSource:0}: Error finding container 9d5cb772403424fce548903eeb1f33a57f8fac92a8f9b6f5ae3051ac88b1643f: Status 404 returned error can't find the container with id 9d5cb772403424fce548903eeb1f33a57f8fac92a8f9b6f5ae3051ac88b1643f Jul 09 14:00:14.904503 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:14.904470 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-57jrl" event={"ID":"85a5f10b-677b-4651-929e-4fe3e29425cc","Type":"ContainerStarted","Data":"9d5cb772403424fce548903eeb1f33a57f8fac92a8f9b6f5ae3051ac88b1643f"} Jul 09 14:00:15.576695 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:15.576665 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:15.673763 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:15.673728 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:16.191171 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:16.191139 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:16.293193 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:16.293156 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:16.917046 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:16.917009 2565 generic.go:356] "Generic (PLEG): container finished" podID="85a5f10b-677b-4651-929e-4fe3e29425cc" containerID="b374065c7a9a4a2b1eeba2537b0b2bbeb499e699de5ad07d1a3e972be69aa176" exitCode=0 Jul 09 14:00:16.917415 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:16.917099 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-57jrl" event={"ID":"85a5f10b-677b-4651-929e-4fe3e29425cc","Type":"ContainerDied","Data":"b374065c7a9a4a2b1eeba2537b0b2bbeb499e699de5ad07d1a3e972be69aa176"} Jul 09 14:00:17.438829 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:17.438798 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:17.582247 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:17.582218 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:17.724320 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:17.724233 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:17.922232 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:17.922200 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-57jrl" event={"ID":"85a5f10b-677b-4651-929e-4fe3e29425cc","Type":"ContainerStarted","Data":"ba4807bc6941d0c541bf2ddd5c8d9a34af2739a7a8b1a2eeab48249a3604459e"} Jul 09 14:00:17.922625 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:17.922254 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-57jrl" event={"ID":"85a5f10b-677b-4651-929e-4fe3e29425cc","Type":"ContainerStarted","Data":"4b86408faf041990ac4dc355e163010181bc5e6ad3f7b1e281f0141c96a5ca60"} Jul 09 14:00:17.943893 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:17.943838 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-57jrl" podStartSLOduration=4.018798809 podStartE2EDuration="5.943822973s" totalImagesPullingTime="1.858164462s" totalInitContainerRuntime="66.859702ms" isStatefulPod=true podCreationTimestamp="2026-07-09 14:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:17.942201888 +0000 UTC m=+117.118889205" watchObservedRunningTime="2026-07-09 14:00:17.943822973 +0000 UTC m=+117.120510265" Jul 09 14:00:18.156946 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:18.156917 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:18.879790 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:18.879758 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:22.855757 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:22.855726 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66f555bfb6-m7pzn" Jul 09 14:00:22.987501 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:22.987463 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:23.091939 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:23.091908 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:23.189140 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:23.189053 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:24.938337 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:24.938309 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:24.999131 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:24.999094 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:26.720817 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:26.720785 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:26.821969 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:26.821934 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:27.893182 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:27.893147 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:27.993532 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:27.993499 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:28.172084 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:28.172006 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:28.376002 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:28.375971 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:29.739773 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:29.739743 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:29.808579 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:29.808545 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:30.109204 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:30.109175 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:30.788660 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:30.788618 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:30.989011 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:30.988977 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:31.020355 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:31.020314 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs\") pod \"network-metrics-daemon-q7c98\" (UID: \"8ac5555e-e619-4a4f-974a-3597a9455f44\") " pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 14:00:31.022621 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:31.022591 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac5555e-e619-4a4f-974a-3597a9455f44-metrics-certs\") pod \"network-metrics-daemon-q7c98\" (UID: \"8ac5555e-e619-4a4f-974a-3597a9455f44\") " pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 14:00:31.159790 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:31.159763 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qwpwr\"" Jul 09 14:00:31.167931 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:31.167910 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7c98" Jul 09 14:00:31.298345 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:31.298315 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q7c98"] Jul 09 14:00:31.301057 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:00:31.301030 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac5555e_e619_4a4f_974a_3597a9455f44.slice/crio-9d6bdf9c6b050f3132829a74f1ee3a5b3ca816b0db09a2666fb781d8a0425164 WatchSource:0}: Error finding container 9d6bdf9c6b050f3132829a74f1ee3a5b3ca816b0db09a2666fb781d8a0425164: Status 404 returned error can't find the container with id 9d6bdf9c6b050f3132829a74f1ee3a5b3ca816b0db09a2666fb781d8a0425164 Jul 09 14:00:31.810875 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:31.810843 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:31.911987 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:31.911951 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:31.971029 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:31.970988 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q7c98" event={"ID":"8ac5555e-e619-4a4f-974a-3597a9455f44","Type":"ContainerStarted","Data":"9d6bdf9c6b050f3132829a74f1ee3a5b3ca816b0db09a2666fb781d8a0425164"} Jul 09 14:00:32.976810 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:32.976780 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q7c98" event={"ID":"8ac5555e-e619-4a4f-974a-3597a9455f44","Type":"ContainerStarted","Data":"c15ca9dbc046ff9b2356242b0621948336ba9e64b386ac74231d7abac91b6ba9"} Jul 09 14:00:32.977174 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:32.976830 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q7c98" event={"ID":"8ac5555e-e619-4a4f-974a-3597a9455f44","Type":"ContainerStarted","Data":"84126f713ddd55b079daa29916fa4608b13253afbdcc26205137407e6279dcbf"} Jul 09 14:00:32.993177 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:32.993122 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q7c98" podStartSLOduration=130.959505743 podStartE2EDuration="2m11.99310612s" totalImagesPullingTime="1.033600377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:00:32.992202875 +0000 UTC m=+132.168890168" watchObservedRunningTime="2026-07-09 14:00:32.99310612 +0000 UTC m=+132.169793444" Jul 09 14:00:33.762626 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:33.762590 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:33.864216 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:33.864163 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:35.478067 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:35.478031 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:35.534359 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:35.534324 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:37.429807 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:37.429772 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:37.483702 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:37.483669 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:43.875758 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:43.875726 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:43.941894 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:43.941856 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:47.609316 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:47.609282 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:47.669459 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:47.669422 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:49.038917 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:49.038830 2565 generic.go:356] "Generic (PLEG): container finished" podID="d981c93c-f315-4b00-b40c-fa777c2080da" containerID="7522683d74d7d1c7e7e52204085f78fd464fbe18c48501afdc1843b4d7a2ed09" exitCode=0 Jul 09 14:00:49.039321 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:49.038907 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" event={"ID":"d981c93c-f315-4b00-b40c-fa777c2080da","Type":"ContainerDied","Data":"7522683d74d7d1c7e7e52204085f78fd464fbe18c48501afdc1843b4d7a2ed09"} Jul 09 14:00:49.039321 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:49.039234 2565 scope.go:117] "RemoveContainer" containerID="7522683d74d7d1c7e7e52204085f78fd464fbe18c48501afdc1843b4d7a2ed09" Jul 09 14:00:50.044387 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:50.044356 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-k9gxf" event={"ID":"d981c93c-f315-4b00-b40c-fa777c2080da","Type":"ContainerStarted","Data":"7bad7a0a71c4899bad8930e85a5f9c07954a5c9b2bfcedab51576df327772a5f"} Jul 09 14:00:52.415314 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:52.415264 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:52.578945 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:52.578909 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:56.681784 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:56.681745 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:56.736666 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:56.736614 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:59.075468 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:59.075433 2565 generic.go:356] "Generic (PLEG): container finished" podID="a1fd29b3-da3d-4685-8b0f-cbb7e7909668" containerID="769a69a0c3550e265919a6c20448728f0bb0165919354d9cc091b04072777072" exitCode=0 Jul 09 14:00:59.075853 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:59.075493 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p" event={"ID":"a1fd29b3-da3d-4685-8b0f-cbb7e7909668","Type":"ContainerDied","Data":"769a69a0c3550e265919a6c20448728f0bb0165919354d9cc091b04072777072"} Jul 09 14:00:59.075853 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:59.075848 2565 scope.go:117] "RemoveContainer" containerID="769a69a0c3550e265919a6c20448728f0bb0165919354d9cc091b04072777072" Jul 09 14:00:59.292401 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:59.292366 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:59.345760 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:59.345659 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:59.639499 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:59.639470 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:59.841434 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:59.841398 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:00:59.889989 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:00:59.889910 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:00.080904 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:00.080877 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-tsz9p" event={"ID":"a1fd29b3-da3d-4685-8b0f-cbb7e7909668","Type":"ContainerStarted","Data":"ddd76707bef77bc73e2b375119b439642b569bf49eeea92c1a4c048026a5dd8f"} Jul 09 14:01:07.426636 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:07.426591 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:07.526345 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:07.526311 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:14.130764 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:14.130729 2565 generic.go:356] "Generic (PLEG): container finished" podID="da81d043-359b-4714-af0f-24709dc95f8c" containerID="61800c3ca80cf98c4f3ff3c75182e5b53c35d83262acdb894d2ceebc24dfcf25" exitCode=0 Jul 09 14:01:14.131132 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:14.130797 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd" event={"ID":"da81d043-359b-4714-af0f-24709dc95f8c","Type":"ContainerDied","Data":"61800c3ca80cf98c4f3ff3c75182e5b53c35d83262acdb894d2ceebc24dfcf25"} Jul 09 14:01:14.131132 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:14.131112 2565 scope.go:117] "RemoveContainer" containerID="61800c3ca80cf98c4f3ff3c75182e5b53c35d83262acdb894d2ceebc24dfcf25" Jul 09 14:01:15.136231 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:15.136194 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2kbkd" event={"ID":"da81d043-359b-4714-af0f-24709dc95f8c","Type":"ContainerStarted","Data":"b5afe1e2eae2c349fe4642fd0a04cc0ed2cb59ca8bb528b2a5dfbdaadeff76e4"} Jul 09 14:01:28.722909 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:28.722878 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:28.783641 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:28.783609 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:29.188580 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:29.188551 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:29.288607 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:29.288578 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:40.413171 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:40.413139 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:40.475452 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:40.475413 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:40.533610 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:40.533580 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:40.676534 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:40.676450 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:41.128177 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:41.128149 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:41.406362 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:41.406270 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:52.436035 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:52.436001 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:52.543604 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:52.543570 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:01:59.849966 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:01:59.849911 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:21.901546 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:02:21.901510 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:21.999561 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:02:21.999529 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:48.572536 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:02:48.572449 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:49.409623 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:02:49.409590 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:52.186005 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:02:52.185968 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:52.286712 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:02:52.286679 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:53.977547 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:02:53.977516 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:54.093955 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:02:54.093921 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:54.295719 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:02:54.295632 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:54.395501 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:02:54.395467 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:56.844563 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:02:56.844530 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:57.066659 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:02:57.066616 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:58.976198 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:02:58.976161 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:02:59.078395 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:02:59.078358 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:04.293016 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:04.292985 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:05.383236 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:05.383206 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:05.482145 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:05.482112 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:08.161868 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:08.161828 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:08.226762 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:08.226724 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:15.265698 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:15.265639 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:15.366330 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:15.366297 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:16.979010 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:16.978980 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:21.198182 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:21.198155 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 14:03:21.200954 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:21.200931 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 14:03:21.205134 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:21.205109 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 14:03:25.673914 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:25.673883 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:29.194148 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:29.194107 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:29.272067 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:29.272036 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:33.199975 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:33.199945 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:33.312457 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:33.312423 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:33.814181 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:33.814145 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:34.056893 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.056866 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:34.159150 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.159122 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:34.189448 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.189411 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n"] Jul 09 14:03:34.191407 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.191386 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:34.195282 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.195259 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 14:03:34.195520 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.195505 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 14:03:34.195600 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.195582 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-shds6\"" Jul 09 14:03:34.195670 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.195634 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 14:03:34.195729 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.195707 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 14:03:34.220429 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.220397 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n"] Jul 09 14:03:34.278514 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.278482 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/56e355dd-5dcd-4dac-b133-74a8e7ad5000-manifests\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-kl69n\" (UID: \"56e355dd-5dcd-4dac-b133-74a8e7ad5000\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:34.278693 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.278534 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/56e355dd-5dcd-4dac-b133-74a8e7ad5000-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-kl69n\" (UID: \"56e355dd-5dcd-4dac-b133-74a8e7ad5000\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:34.278693 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.278559 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56e355dd-5dcd-4dac-b133-74a8e7ad5000-webhook-cert\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-kl69n\" (UID: \"56e355dd-5dcd-4dac-b133-74a8e7ad5000\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:34.278693 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.278590 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56e355dd-5dcd-4dac-b133-74a8e7ad5000-tmp\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-kl69n\" (UID: \"56e355dd-5dcd-4dac-b133-74a8e7ad5000\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:34.278693 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.278616 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppk92\" (UniqueName: \"kubernetes.io/projected/56e355dd-5dcd-4dac-b133-74a8e7ad5000-kube-api-access-ppk92\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-kl69n\" (UID: \"56e355dd-5dcd-4dac-b133-74a8e7ad5000\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:34.379027 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.378990 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/56e355dd-5dcd-4dac-b133-74a8e7ad5000-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-kl69n\" (UID: \"56e355dd-5dcd-4dac-b133-74a8e7ad5000\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:34.379027 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.379028 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56e355dd-5dcd-4dac-b133-74a8e7ad5000-webhook-cert\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-kl69n\" (UID: \"56e355dd-5dcd-4dac-b133-74a8e7ad5000\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:34.379283 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.379056 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56e355dd-5dcd-4dac-b133-74a8e7ad5000-tmp\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-kl69n\" (UID: \"56e355dd-5dcd-4dac-b133-74a8e7ad5000\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:34.379283 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.379199 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppk92\" (UniqueName: \"kubernetes.io/projected/56e355dd-5dcd-4dac-b133-74a8e7ad5000-kube-api-access-ppk92\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-kl69n\" (UID: \"56e355dd-5dcd-4dac-b133-74a8e7ad5000\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:34.379397 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.379304 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/56e355dd-5dcd-4dac-b133-74a8e7ad5000-manifests\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-kl69n\" (UID: \"56e355dd-5dcd-4dac-b133-74a8e7ad5000\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:34.379673 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.379625 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/56e355dd-5dcd-4dac-b133-74a8e7ad5000-manifests\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-kl69n\" (UID: \"56e355dd-5dcd-4dac-b133-74a8e7ad5000\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:34.381426 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.381404 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56e355dd-5dcd-4dac-b133-74a8e7ad5000-tmp\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-kl69n\" (UID: \"56e355dd-5dcd-4dac-b133-74a8e7ad5000\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:34.381512 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.381439 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/56e355dd-5dcd-4dac-b133-74a8e7ad5000-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-kl69n\" (UID: \"56e355dd-5dcd-4dac-b133-74a8e7ad5000\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:34.381512 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.381491 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56e355dd-5dcd-4dac-b133-74a8e7ad5000-webhook-cert\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-kl69n\" (UID: \"56e355dd-5dcd-4dac-b133-74a8e7ad5000\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:34.387943 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.387923 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppk92\" (UniqueName: \"kubernetes.io/projected/56e355dd-5dcd-4dac-b133-74a8e7ad5000-kube-api-access-ppk92\") pod \"opendatahub-operator-controller-manager-78fdd99dcd-kl69n\" (UID: \"56e355dd-5dcd-4dac-b133-74a8e7ad5000\") " pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:34.393931 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.393907 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:34.495445 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.495370 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:34.501383 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.501362 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:34.595606 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.595571 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:34.631620 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.631576 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n"] Jul 09 14:03:34.634503 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:03:34.634477 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e355dd_5dcd_4dac_b133_74a8e7ad5000.slice/crio-942ce2204048055a383789c384d9bed9920947bd549121eba8e58b4fc53f8252 WatchSource:0}: Error finding container 942ce2204048055a383789c384d9bed9920947bd549121eba8e58b4fc53f8252: Status 404 returned error can't find the container with id 942ce2204048055a383789c384d9bed9920947bd549121eba8e58b4fc53f8252 Jul 09 14:03:34.636342 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.636323 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:03:34.687086 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.687050 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:34.753943 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:34.753831 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:35.622631 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:35.622594 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" event={"ID":"56e355dd-5dcd-4dac-b133-74a8e7ad5000","Type":"ContainerStarted","Data":"942ce2204048055a383789c384d9bed9920947bd549121eba8e58b4fc53f8252"} Jul 09 14:03:38.635403 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:38.635367 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" event={"ID":"56e355dd-5dcd-4dac-b133-74a8e7ad5000","Type":"ContainerStarted","Data":"4b75bc5568572eea704266c0af5ba3e58cda879f9532487f3bf5d0f11c735684"} Jul 09 14:03:39.640451 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:39.640410 2565 generic.go:356] "Generic (PLEG): container finished" podID="56e355dd-5dcd-4dac-b133-74a8e7ad5000" containerID="4b75bc5568572eea704266c0af5ba3e58cda879f9532487f3bf5d0f11c735684" exitCode=0 Jul 09 14:03:39.640845 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:39.640495 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" event={"ID":"56e355dd-5dcd-4dac-b133-74a8e7ad5000","Type":"ContainerDied","Data":"4b75bc5568572eea704266c0af5ba3e58cda879f9532487f3bf5d0f11c735684"} Jul 09 14:03:40.645356 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:40.645312 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" event={"ID":"56e355dd-5dcd-4dac-b133-74a8e7ad5000","Type":"ContainerStarted","Data":"7116e5aec950a214a7c4fc1f4cf246850f9685e96ff29f03b8e146635d2948a8"} Jul 09 14:03:40.645890 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:40.645413 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:40.668813 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:40.668756 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" podStartSLOduration=2.04989578 podStartE2EDuration="6.668735648s" totalImagesPullingTime="3.53822449s" totalInitContainerRuntime="1.080615378s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:40.666694312 +0000 UTC m=+319.843381604" watchObservedRunningTime="2026-07-09 14:03:40.668735648 +0000 UTC m=+319.845422942" Jul 09 14:03:46.195668 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:46.195612 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:46.294596 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:46.294564 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:51.651372 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:51.651340 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78fdd99dcd-kl69n" Jul 09 14:03:57.150275 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:57.150233 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:57.863911 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:57.863880 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-78985cb57d-4cw4h"] Jul 09 14:03:57.874927 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:57.874908 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78985cb57d-4cw4h" Jul 09 14:03:57.878153 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:57.878131 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 14:03:57.879812 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:57.879789 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 14:03:57.879932 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:57.879811 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 14:03:57.879932 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:57.879878 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-b9nrc\"" Jul 09 14:03:57.880057 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:57.880008 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 14:03:57.883755 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:57.883732 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78985cb57d-4cw4h"] Jul 09 14:03:57.966380 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:57.966351 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c438d803-ee70-42c6-a9d8-439de09747d6-tls-certs\") pod \"kube-auth-proxy-78985cb57d-4cw4h\" (UID: \"c438d803-ee70-42c6-a9d8-439de09747d6\") " pod="openshift-ingress/kube-auth-proxy-78985cb57d-4cw4h" Jul 09 14:03:57.966545 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:57.966398 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c438d803-ee70-42c6-a9d8-439de09747d6-tmp\") pod \"kube-auth-proxy-78985cb57d-4cw4h\" (UID: \"c438d803-ee70-42c6-a9d8-439de09747d6\") " pod="openshift-ingress/kube-auth-proxy-78985cb57d-4cw4h" Jul 09 14:03:57.966545 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:57.966470 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qdll\" (UniqueName: \"kubernetes.io/projected/c438d803-ee70-42c6-a9d8-439de09747d6-kube-api-access-6qdll\") pod \"kube-auth-proxy-78985cb57d-4cw4h\" (UID: \"c438d803-ee70-42c6-a9d8-439de09747d6\") " pod="openshift-ingress/kube-auth-proxy-78985cb57d-4cw4h" Jul 09 14:03:58.025427 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.025389 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-j4j6m"] Jul 09 14:03:58.028577 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.028552 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-j4j6m" Jul 09 14:03:58.031928 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.031906 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 09 14:03:58.032054 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.031947 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jbvk7\"" Jul 09 14:03:58.047703 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.047674 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-j4j6m"] Jul 09 14:03:58.067008 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.066981 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c438d803-ee70-42c6-a9d8-439de09747d6-tls-certs\") pod \"kube-auth-proxy-78985cb57d-4cw4h\" (UID: \"c438d803-ee70-42c6-a9d8-439de09747d6\") " pod="openshift-ingress/kube-auth-proxy-78985cb57d-4cw4h" Jul 09 14:03:58.067147 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.067025 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c438d803-ee70-42c6-a9d8-439de09747d6-tmp\") pod \"kube-auth-proxy-78985cb57d-4cw4h\" (UID: \"c438d803-ee70-42c6-a9d8-439de09747d6\") " pod="openshift-ingress/kube-auth-proxy-78985cb57d-4cw4h" Jul 09 14:03:58.067147 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.067061 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qdll\" (UniqueName: \"kubernetes.io/projected/c438d803-ee70-42c6-a9d8-439de09747d6-kube-api-access-6qdll\") pod \"kube-auth-proxy-78985cb57d-4cw4h\" (UID: \"c438d803-ee70-42c6-a9d8-439de09747d6\") " pod="openshift-ingress/kube-auth-proxy-78985cb57d-4cw4h" Jul 09 14:03:58.069316 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.069288 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c438d803-ee70-42c6-a9d8-439de09747d6-tmp\") pod \"kube-auth-proxy-78985cb57d-4cw4h\" (UID: \"c438d803-ee70-42c6-a9d8-439de09747d6\") " pod="openshift-ingress/kube-auth-proxy-78985cb57d-4cw4h" Jul 09 14:03:58.069533 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.069513 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c438d803-ee70-42c6-a9d8-439de09747d6-tls-certs\") pod \"kube-auth-proxy-78985cb57d-4cw4h\" (UID: \"c438d803-ee70-42c6-a9d8-439de09747d6\") " pod="openshift-ingress/kube-auth-proxy-78985cb57d-4cw4h" Jul 09 14:03:58.093185 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.093155 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qdll\" (UniqueName: \"kubernetes.io/projected/c438d803-ee70-42c6-a9d8-439de09747d6-kube-api-access-6qdll\") pod \"kube-auth-proxy-78985cb57d-4cw4h\" (UID: \"c438d803-ee70-42c6-a9d8-439de09747d6\") " pod="openshift-ingress/kube-auth-proxy-78985cb57d-4cw4h" Jul 09 14:03:58.167521 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.167421 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5xb7\" (UniqueName: \"kubernetes.io/projected/ee3e973f-484b-48cd-9d1c-c5e6478f5389-kube-api-access-f5xb7\") pod \"odh-model-controller-7998c67dc4-j4j6m\" (UID: \"ee3e973f-484b-48cd-9d1c-c5e6478f5389\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4j6m" Jul 09 14:03:58.167521 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.167475 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee3e973f-484b-48cd-9d1c-c5e6478f5389-cert\") pod \"odh-model-controller-7998c67dc4-j4j6m\" (UID: \"ee3e973f-484b-48cd-9d1c-c5e6478f5389\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4j6m" Jul 09 14:03:58.185397 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.185366 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78985cb57d-4cw4h" Jul 09 14:03:58.268281 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.268245 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5xb7\" (UniqueName: \"kubernetes.io/projected/ee3e973f-484b-48cd-9d1c-c5e6478f5389-kube-api-access-f5xb7\") pod \"odh-model-controller-7998c67dc4-j4j6m\" (UID: \"ee3e973f-484b-48cd-9d1c-c5e6478f5389\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4j6m" Jul 09 14:03:58.268414 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.268391 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee3e973f-484b-48cd-9d1c-c5e6478f5389-cert\") pod \"odh-model-controller-7998c67dc4-j4j6m\" (UID: \"ee3e973f-484b-48cd-9d1c-c5e6478f5389\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4j6m" Jul 09 14:03:58.268533 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:03:58.268519 2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 09 14:03:58.268601 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:03:58.268591 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee3e973f-484b-48cd-9d1c-c5e6478f5389-cert podName:ee3e973f-484b-48cd-9d1c-c5e6478f5389 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:58.768569614 +0000 UTC m=+337.945256887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ee3e973f-484b-48cd-9d1c-c5e6478f5389-cert") pod "odh-model-controller-7998c67dc4-j4j6m" (UID: "ee3e973f-484b-48cd-9d1c-c5e6478f5389") : secret "odh-model-controller-webhook-cert" not found Jul 09 14:03:58.287030 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.286286 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5xb7\" (UniqueName: \"kubernetes.io/projected/ee3e973f-484b-48cd-9d1c-c5e6478f5389-kube-api-access-f5xb7\") pod \"odh-model-controller-7998c67dc4-j4j6m\" (UID: \"ee3e973f-484b-48cd-9d1c-c5e6478f5389\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4j6m" Jul 09 14:03:58.321591 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.321559 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78985cb57d-4cw4h"] Jul 09 14:03:58.325179 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:03:58.325154 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc438d803_ee70_42c6_a9d8_439de09747d6.slice/crio-e07032e6bf4fc529622118a2dbea7e27dba8a1318539465fa0c22d2b2a4e9bf5 WatchSource:0}: Error finding container e07032e6bf4fc529622118a2dbea7e27dba8a1318539465fa0c22d2b2a4e9bf5: Status 404 returned error can't find the container with id e07032e6bf4fc529622118a2dbea7e27dba8a1318539465fa0c22d2b2a4e9bf5 Jul 09 14:03:58.711315 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.711279 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78985cb57d-4cw4h" event={"ID":"c438d803-ee70-42c6-a9d8-439de09747d6","Type":"ContainerStarted","Data":"e07032e6bf4fc529622118a2dbea7e27dba8a1318539465fa0c22d2b2a4e9bf5"} Jul 09 14:03:58.723593 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.723565 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:58.773945 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.773914 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee3e973f-484b-48cd-9d1c-c5e6478f5389-cert\") pod \"odh-model-controller-7998c67dc4-j4j6m\" (UID: \"ee3e973f-484b-48cd-9d1c-c5e6478f5389\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4j6m" Jul 09 14:03:58.776544 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.776520 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee3e973f-484b-48cd-9d1c-c5e6478f5389-cert\") pod \"odh-model-controller-7998c67dc4-j4j6m\" (UID: \"ee3e973f-484b-48cd-9d1c-c5e6478f5389\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4j6m" Jul 09 14:03:58.938662 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.938616 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-j4j6m" Jul 09 14:03:58.953672 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.953629 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:58.975391 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.975313 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-9klgb"] Jul 09 14:03:58.979097 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.979069 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-9klgb" Jul 09 14:03:58.982034 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.982012 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 09 14:03:58.982034 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.982033 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-5n8vc\"" Jul 09 14:03:58.989832 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:58.989788 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-9klgb"] Jul 09 14:03:59.076087 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.076058 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/313220d7-23d4-4761-a8e8-7cbec6410999-tls-certs\") pod \"model-serving-api-54d89bd5fc-9klgb\" (UID: \"313220d7-23d4-4761-a8e8-7cbec6410999\") " pod="opendatahub/model-serving-api-54d89bd5fc-9klgb" Jul 09 14:03:59.076438 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.076409 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85bdz\" (UniqueName: \"kubernetes.io/projected/313220d7-23d4-4761-a8e8-7cbec6410999-kube-api-access-85bdz\") pod \"model-serving-api-54d89bd5fc-9klgb\" (UID: \"313220d7-23d4-4761-a8e8-7cbec6410999\") " pod="opendatahub/model-serving-api-54d89bd5fc-9klgb" Jul 09 14:03:59.079284 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.079268 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-j4j6m"] Jul 09 14:03:59.081667 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:03:59.081627 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3e973f_484b_48cd_9d1c_c5e6478f5389.slice/crio-e70cdc5fb200dd6c35ae4dd8d8df98d277250b0da15a2d48391cd9cdc4e4f619 WatchSource:0}: Error finding container e70cdc5fb200dd6c35ae4dd8d8df98d277250b0da15a2d48391cd9cdc4e4f619: Status 404 returned error can't find the container with id e70cdc5fb200dd6c35ae4dd8d8df98d277250b0da15a2d48391cd9cdc4e4f619 Jul 09 14:03:59.144213 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.144174 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz"] Jul 09 14:03:59.147285 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.147263 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.148732 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.148709 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:59.150085 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.150069 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 14:03:59.150158 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.150100 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 14:03:59.150216 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.150174 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cstvf\"" Jul 09 14:03:59.150368 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.150354 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 14:03:59.150434 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.150420 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 14:03:59.161686 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.161638 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz"] Jul 09 14:03:59.177475 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.177452 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85bdz\" (UniqueName: \"kubernetes.io/projected/313220d7-23d4-4761-a8e8-7cbec6410999-kube-api-access-85bdz\") pod \"model-serving-api-54d89bd5fc-9klgb\" (UID: \"313220d7-23d4-4761-a8e8-7cbec6410999\") " pod="opendatahub/model-serving-api-54d89bd5fc-9klgb" Jul 09 14:03:59.177874 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.177505 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/313220d7-23d4-4761-a8e8-7cbec6410999-tls-certs\") pod \"model-serving-api-54d89bd5fc-9klgb\" (UID: \"313220d7-23d4-4761-a8e8-7cbec6410999\") " pod="opendatahub/model-serving-api-54d89bd5fc-9klgb" Jul 09 14:03:59.177874 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:03:59.177668 2565 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 09 14:03:59.177874 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:03:59.177734 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/313220d7-23d4-4761-a8e8-7cbec6410999-tls-certs podName:313220d7-23d4-4761-a8e8-7cbec6410999 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:59.677712135 +0000 UTC m=+338.854399405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/313220d7-23d4-4761-a8e8-7cbec6410999-tls-certs") pod "model-serving-api-54d89bd5fc-9klgb" (UID: "313220d7-23d4-4761-a8e8-7cbec6410999") : secret "model-serving-api-tls" not found Jul 09 14:03:59.190662 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.190628 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85bdz\" (UniqueName: \"kubernetes.io/projected/313220d7-23d4-4761-a8e8-7cbec6410999-kube-api-access-85bdz\") pod \"model-serving-api-54d89bd5fc-9klgb\" (UID: \"313220d7-23d4-4761-a8e8-7cbec6410999\") " pod="opendatahub/model-serving-api-54d89bd5fc-9klgb" Jul 09 14:03:59.251328 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.251250 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:59.278480 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.278449 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.278812 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.278501 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.278812 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.278596 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-local-certs\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.278812 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.278626 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.278812 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.278692 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wpgw\" (UniqueName: \"kubernetes.io/projected/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-kube-api-access-6wpgw\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.278812 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.278735 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-token\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.278812 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.278781 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-cacerts\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.348022 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.347985 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:59.379971 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.379941 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.380134 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.379981 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.380134 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.380021 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-local-certs\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.380134 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.380043 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.380134 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.380090 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wpgw\" (UniqueName: \"kubernetes.io/projected/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-kube-api-access-6wpgw\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.380134 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.380135 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-token\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.380439 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.380169 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-cacerts\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.380833 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.380769 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.382604 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.382562 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-cacerts\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.382821 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.382799 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.382879 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.382845 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-local-certs\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.383000 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.382984 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.388613 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.388587 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-token\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.389221 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.389204 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wpgw\" (UniqueName: \"kubernetes.io/projected/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-kube-api-access-6wpgw\") pod \"istiod-openshift-gateway-7574459656-cj9gz\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.457456 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.457422 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:03:59.589795 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.589771 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz"] Jul 09 14:03:59.592043 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:03:59.592013 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod139eda35_98a3_4a0e_b59e_2e420e9c7ec8.slice/crio-a076d5137a028e9fa999e2240e4aa91ed5a079f946448b76b3739f6f123de9fe WatchSource:0}: Error finding container a076d5137a028e9fa999e2240e4aa91ed5a079f946448b76b3739f6f123de9fe: Status 404 returned error can't find the container with id a076d5137a028e9fa999e2240e4aa91ed5a079f946448b76b3739f6f123de9fe Jul 09 14:03:59.683569 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.683535 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/313220d7-23d4-4761-a8e8-7cbec6410999-tls-certs\") pod \"model-serving-api-54d89bd5fc-9klgb\" (UID: \"313220d7-23d4-4761-a8e8-7cbec6410999\") " pod="opendatahub/model-serving-api-54d89bd5fc-9klgb" Jul 09 14:03:59.685978 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.685953 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/313220d7-23d4-4761-a8e8-7cbec6410999-tls-certs\") pod \"model-serving-api-54d89bd5fc-9klgb\" (UID: \"313220d7-23d4-4761-a8e8-7cbec6410999\") " pod="opendatahub/model-serving-api-54d89bd5fc-9klgb" Jul 09 14:03:59.717148 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.717101 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" event={"ID":"139eda35-98a3-4a0e-b59e-2e420e9c7ec8","Type":"ContainerStarted","Data":"a076d5137a028e9fa999e2240e4aa91ed5a079f946448b76b3739f6f123de9fe"} Jul 09 14:03:59.718315 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.718290 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-j4j6m" event={"ID":"ee3e973f-484b-48cd-9d1c-c5e6478f5389","Type":"ContainerStarted","Data":"e70cdc5fb200dd6c35ae4dd8d8df98d277250b0da15a2d48391cd9cdc4e4f619"} Jul 09 14:03:59.891835 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:03:59.891792 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-9klgb" Jul 09 14:04:00.111451 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:00.111335 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-9klgb"] Jul 09 14:04:00.114858 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:04:00.114822 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod313220d7_23d4_4761_a8e8_7cbec6410999.slice/crio-96a100759e6c0ab32b86eae8d6b558aac73870a63143eb1eab1980c806d1ba47 WatchSource:0}: Error finding container 96a100759e6c0ab32b86eae8d6b558aac73870a63143eb1eab1980c806d1ba47: Status 404 returned error can't find the container with id 96a100759e6c0ab32b86eae8d6b558aac73870a63143eb1eab1980c806d1ba47 Jul 09 14:04:00.147867 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:00.147783 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:00.728108 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:00.728064 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-9klgb" event={"ID":"313220d7-23d4-4761-a8e8-7cbec6410999","Type":"ContainerStarted","Data":"96a100759e6c0ab32b86eae8d6b558aac73870a63143eb1eab1980c806d1ba47"} Jul 09 14:04:04.772737 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:04.772687 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 14:04:04.773116 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:04.772759 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 14:04:05.753612 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:05.753572 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78985cb57d-4cw4h" event={"ID":"c438d803-ee70-42c6-a9d8-439de09747d6","Type":"ContainerStarted","Data":"8dd42d01b4625e44ddaf95421f67dcf4f61b7aeea457fb186fcb8639a393ff29"} Jul 09 14:04:05.755197 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:05.755172 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-j4j6m" event={"ID":"ee3e973f-484b-48cd-9d1c-c5e6478f5389","Type":"ContainerStarted","Data":"71488256ef32b251b97eaa4010f6d5917645b239ff4550d41c8dbc0a92a370ba"} Jul 09 14:04:05.755323 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:05.755250 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-j4j6m" Jul 09 14:04:05.756697 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:05.756675 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" event={"ID":"139eda35-98a3-4a0e-b59e-2e420e9c7ec8","Type":"ContainerStarted","Data":"dac8083bb76a46a51cece9f7df8a199f65b81c3d8cf575948105c0621295c4aa"} Jul 09 14:04:05.756872 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:05.756857 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:04:05.758091 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:05.758067 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-9klgb" event={"ID":"313220d7-23d4-4761-a8e8-7cbec6410999","Type":"ContainerStarted","Data":"51156fb252521278d341119053027117fd766e3dacdd38f5eac7d278ea7c3270"} Jul 09 14:04:05.758202 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:05.758188 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-9klgb" Jul 09 14:04:05.758621 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:05.758600 2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-cj9gz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 14:04:05.758728 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:05.758640 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" podUID="139eda35-98a3-4a0e-b59e-2e420e9c7ec8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 14:04:05.776880 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:05.776826 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-78985cb57d-4cw4h" podStartSLOduration=2.328493294 podStartE2EDuration="8.776808815s" totalImagesPullingTime="6.448315521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:05.775791505 +0000 UTC m=+344.952478797" watchObservedRunningTime="2026-07-09 14:04:05.776808815 +0000 UTC m=+344.953496109" Jul 09 14:04:05.801716 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:05.801616 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" podStartSLOduration=1.623158955 podStartE2EDuration="6.801594539s" totalImagesPullingTime="5.178435584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:05.801529092 +0000 UTC m=+344.978216384" watchObservedRunningTime="2026-07-09 14:04:05.801594539 +0000 UTC m=+344.978281831" Jul 09 14:04:05.822065 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:05.822002 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-9klgb" podStartSLOduration=3.162970602 podStartE2EDuration="7.821983111s" totalImagesPullingTime="4.659012509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:05.82095963 +0000 UTC m=+344.997646945" watchObservedRunningTime="2026-07-09 14:04:05.821983111 +0000 UTC m=+344.998670403" Jul 09 14:04:05.851242 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:05.851176 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-j4j6m" podStartSLOduration=3.166769662 podStartE2EDuration="8.851151587s" totalImagesPullingTime="5.684381925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:05.849527087 +0000 UTC m=+345.026214390" watchObservedRunningTime="2026-07-09 14:04:05.851151587 +0000 UTC m=+345.027838880" Jul 09 14:04:05.900730 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:05.900698 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:06.006596 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:06.006501 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:06.226483 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:06.226453 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:06.391985 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:06.391949 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:06.530443 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:06.530408 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:06.762958 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:06.762887 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:04:09.128952 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.128921 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:09.182779 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.182747 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ggbmf"] Jul 09 14:04:09.186038 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.186018 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ggbmf" Jul 09 14:04:09.190802 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.190779 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 09 14:04:09.190905 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.190804 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-75zdj\"" Jul 09 14:04:09.202293 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.202259 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ggbmf"] Jul 09 14:04:09.203585 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.203558 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9zg7t"] Jul 09 14:04:09.206875 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.206853 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9zg7t" Jul 09 14:04:09.209683 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.209633 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 09 14:04:09.209683 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.209673 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-rhzdg\"" Jul 09 14:04:09.218269 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.218243 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9zg7t"] Jul 09 14:04:09.230902 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.230869 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:09.275342 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.275309 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37c36d43-31a3-4a40-a544-35422438164b-cert\") pod \"kserve-controller-manager-d6f4b65b8-ggbmf\" (UID: \"37c36d43-31a3-4a40-a544-35422438164b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ggbmf" Jul 09 14:04:09.275495 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.275347 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wghdk\" (UniqueName: \"kubernetes.io/projected/37c36d43-31a3-4a40-a544-35422438164b-kube-api-access-wghdk\") pod \"kserve-controller-manager-d6f4b65b8-ggbmf\" (UID: \"37c36d43-31a3-4a40-a544-35422438164b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ggbmf" Jul 09 14:04:09.329118 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.329076 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:09.375976 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.375946 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37c36d43-31a3-4a40-a544-35422438164b-cert\") pod \"kserve-controller-manager-d6f4b65b8-ggbmf\" (UID: \"37c36d43-31a3-4a40-a544-35422438164b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ggbmf" Jul 09 14:04:09.375976 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.375981 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wghdk\" (UniqueName: \"kubernetes.io/projected/37c36d43-31a3-4a40-a544-35422438164b-kube-api-access-wghdk\") pod \"kserve-controller-manager-d6f4b65b8-ggbmf\" (UID: \"37c36d43-31a3-4a40-a544-35422438164b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ggbmf" Jul 09 14:04:09.376236 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.376025 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzqbd\" (UniqueName: \"kubernetes.io/projected/94ec4d53-28dd-4152-aa68-1f6968ba6d1d-kube-api-access-jzqbd\") pod \"llmisvc-controller-manager-777c6bd7d5-9zg7t\" (UID: \"94ec4d53-28dd-4152-aa68-1f6968ba6d1d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9zg7t" Jul 09 14:04:09.376236 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.376045 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94ec4d53-28dd-4152-aa68-1f6968ba6d1d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9zg7t\" (UID: \"94ec4d53-28dd-4152-aa68-1f6968ba6d1d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9zg7t" Jul 09 14:04:09.378418 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.378395 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37c36d43-31a3-4a40-a544-35422438164b-cert\") pod \"kserve-controller-manager-d6f4b65b8-ggbmf\" (UID: \"37c36d43-31a3-4a40-a544-35422438164b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ggbmf" Jul 09 14:04:09.395001 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.394943 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wghdk\" (UniqueName: \"kubernetes.io/projected/37c36d43-31a3-4a40-a544-35422438164b-kube-api-access-wghdk\") pod \"kserve-controller-manager-d6f4b65b8-ggbmf\" (UID: \"37c36d43-31a3-4a40-a544-35422438164b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ggbmf" Jul 09 14:04:09.476623 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.476591 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzqbd\" (UniqueName: \"kubernetes.io/projected/94ec4d53-28dd-4152-aa68-1f6968ba6d1d-kube-api-access-jzqbd\") pod \"llmisvc-controller-manager-777c6bd7d5-9zg7t\" (UID: \"94ec4d53-28dd-4152-aa68-1f6968ba6d1d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9zg7t" Jul 09 14:04:09.476623 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.476623 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94ec4d53-28dd-4152-aa68-1f6968ba6d1d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9zg7t\" (UID: \"94ec4d53-28dd-4152-aa68-1f6968ba6d1d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9zg7t" Jul 09 14:04:09.479070 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.479051 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94ec4d53-28dd-4152-aa68-1f6968ba6d1d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9zg7t\" (UID: \"94ec4d53-28dd-4152-aa68-1f6968ba6d1d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9zg7t" Jul 09 14:04:09.487815 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.487792 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzqbd\" (UniqueName: \"kubernetes.io/projected/94ec4d53-28dd-4152-aa68-1f6968ba6d1d-kube-api-access-jzqbd\") pod \"llmisvc-controller-manager-777c6bd7d5-9zg7t\" (UID: \"94ec4d53-28dd-4152-aa68-1f6968ba6d1d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9zg7t" Jul 09 14:04:09.500628 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.500600 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ggbmf" Jul 09 14:04:09.519022 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.518996 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9zg7t" Jul 09 14:04:09.653827 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.653798 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ggbmf"] Jul 09 14:04:09.655612 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:04:09.655585 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c36d43_31a3_4a40_a544_35422438164b.slice/crio-0a261aab0bc94ed1ce0a2b2e0ed3a212cb66460f4e4adc6904b7ad850541e125 WatchSource:0}: Error finding container 0a261aab0bc94ed1ce0a2b2e0ed3a212cb66460f4e4adc6904b7ad850541e125: Status 404 returned error can't find the container with id 0a261aab0bc94ed1ce0a2b2e0ed3a212cb66460f4e4adc6904b7ad850541e125 Jul 09 14:04:09.668319 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.668294 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9zg7t"] Jul 09 14:04:09.671153 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:04:09.671130 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod94ec4d53_28dd_4152_aa68_1f6968ba6d1d.slice/crio-6af928d13cec070a47c8e70286992e5d4322c846bb38e339f4a75c73c3c69036 WatchSource:0}: Error finding container 6af928d13cec070a47c8e70286992e5d4322c846bb38e339f4a75c73c3c69036: Status 404 returned error can't find the container with id 6af928d13cec070a47c8e70286992e5d4322c846bb38e339f4a75c73c3c69036 Jul 09 14:04:09.776033 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.775998 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ggbmf" event={"ID":"37c36d43-31a3-4a40-a544-35422438164b","Type":"ContainerStarted","Data":"0a261aab0bc94ed1ce0a2b2e0ed3a212cb66460f4e4adc6904b7ad850541e125"} Jul 09 14:04:09.777139 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:09.777112 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9zg7t" event={"ID":"94ec4d53-28dd-4152-aa68-1f6968ba6d1d","Type":"ContainerStarted","Data":"6af928d13cec070a47c8e70286992e5d4322c846bb38e339f4a75c73c3c69036"} Jul 09 14:04:10.401713 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:10.401679 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:10.557550 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:10.557521 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:10.626929 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:10.626901 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:13.076428 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.076346 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz"] Jul 09 14:04:13.077161 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.076626 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" podUID="139eda35-98a3-4a0e-b59e-2e420e9c7ec8" containerName="discovery" containerID="cri-o://dac8083bb76a46a51cece9f7df8a199f65b81c3d8cf575948105c0621295c4aa" gracePeriod=30 Jul 09 14:04:13.335157 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.335093 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:04:13.511201 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.511165 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-token\") pod \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " Jul 09 14:04:13.511378 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.511210 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-cacerts\") pod \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " Jul 09 14:04:13.511378 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.511230 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-csr-dns-cert\") pod \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " Jul 09 14:04:13.511378 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.511269 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-csr-ca-configmap\") pod \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " Jul 09 14:04:13.511378 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.511292 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wpgw\" (UniqueName: \"kubernetes.io/projected/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-kube-api-access-6wpgw\") pod \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " Jul 09 14:04:13.511378 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.511306 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-kubeconfig\") pod \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " Jul 09 14:04:13.511378 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.511335 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-local-certs\") pod \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\" (UID: \"139eda35-98a3-4a0e-b59e-2e420e9c7ec8\") " Jul 09 14:04:13.511741 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.511707 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "139eda35-98a3-4a0e-b59e-2e420e9c7ec8" (UID: "139eda35-98a3-4a0e-b59e-2e420e9c7ec8"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:04:13.513915 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.513888 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-cacerts" (OuterVolumeSpecName: "cacerts") pod "139eda35-98a3-4a0e-b59e-2e420e9c7ec8" (UID: "139eda35-98a3-4a0e-b59e-2e420e9c7ec8"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:04:13.514121 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.514074 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-local-certs" (OuterVolumeSpecName: "local-certs") pod "139eda35-98a3-4a0e-b59e-2e420e9c7ec8" (UID: "139eda35-98a3-4a0e-b59e-2e420e9c7ec8"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:04:13.514121 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.514086 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-kube-api-access-6wpgw" (OuterVolumeSpecName: "kube-api-access-6wpgw") pod "139eda35-98a3-4a0e-b59e-2e420e9c7ec8" (UID: "139eda35-98a3-4a0e-b59e-2e420e9c7ec8"). InnerVolumeSpecName "kube-api-access-6wpgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:04:13.514295 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.514086 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-token" (OuterVolumeSpecName: "istio-token") pod "139eda35-98a3-4a0e-b59e-2e420e9c7ec8" (UID: "139eda35-98a3-4a0e-b59e-2e420e9c7ec8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:04:13.514295 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.514156 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "139eda35-98a3-4a0e-b59e-2e420e9c7ec8" (UID: "139eda35-98a3-4a0e-b59e-2e420e9c7ec8"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:04:13.514295 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.514216 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "139eda35-98a3-4a0e-b59e-2e420e9c7ec8" (UID: "139eda35-98a3-4a0e-b59e-2e420e9c7ec8"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:04:13.612619 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.612577 2565 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-cacerts\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:04:13.612619 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.612610 2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-csr-dns-cert\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:04:13.612619 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.612620 2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-csr-ca-configmap\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:04:13.612619 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.612629 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wpgw\" (UniqueName: \"kubernetes.io/projected/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-kube-api-access-6wpgw\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:04:13.612999 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.612638 2565 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-kubeconfig\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:04:13.612999 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.612658 2565 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-local-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:04:13.612999 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.612666 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/139eda35-98a3-4a0e-b59e-2e420e9c7ec8-istio-token\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:04:13.797611 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.797574 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ggbmf" event={"ID":"37c36d43-31a3-4a40-a544-35422438164b","Type":"ContainerStarted","Data":"bda7fb288070d7b1f3bdd344204e2816e4ae4539a36a04b271497afde2d88954"} Jul 09 14:04:13.797798 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.797748 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ggbmf" Jul 09 14:04:13.799108 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.799082 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9zg7t" event={"ID":"94ec4d53-28dd-4152-aa68-1f6968ba6d1d","Type":"ContainerStarted","Data":"1ed86cd256fc4bfe3f7e659b1061168b7cbe86455574e8a373fd59fcc5c53c62"} Jul 09 14:04:13.799211 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.799133 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9zg7t" Jul 09 14:04:13.800226 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.800205 2565 generic.go:356] "Generic (PLEG): container finished" podID="139eda35-98a3-4a0e-b59e-2e420e9c7ec8" containerID="dac8083bb76a46a51cece9f7df8a199f65b81c3d8cf575948105c0621295c4aa" exitCode=0 Jul 09 14:04:13.800315 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.800241 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" Jul 09 14:04:13.800315 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.800263 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" event={"ID":"139eda35-98a3-4a0e-b59e-2e420e9c7ec8","Type":"ContainerDied","Data":"dac8083bb76a46a51cece9f7df8a199f65b81c3d8cf575948105c0621295c4aa"} Jul 09 14:04:13.800315 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.800305 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz" event={"ID":"139eda35-98a3-4a0e-b59e-2e420e9c7ec8","Type":"ContainerDied","Data":"a076d5137a028e9fa999e2240e4aa91ed5a079f946448b76b3739f6f123de9fe"} Jul 09 14:04:13.800469 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.800333 2565 scope.go:117] "RemoveContainer" containerID="dac8083bb76a46a51cece9f7df8a199f65b81c3d8cf575948105c0621295c4aa" Jul 09 14:04:13.809394 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.809375 2565 scope.go:117] "RemoveContainer" containerID="dac8083bb76a46a51cece9f7df8a199f65b81c3d8cf575948105c0621295c4aa" Jul 09 14:04:13.809674 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:04:13.809634 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dac8083bb76a46a51cece9f7df8a199f65b81c3d8cf575948105c0621295c4aa\": container with ID starting with dac8083bb76a46a51cece9f7df8a199f65b81c3d8cf575948105c0621295c4aa not found: ID does not exist" containerID="dac8083bb76a46a51cece9f7df8a199f65b81c3d8cf575948105c0621295c4aa" Jul 09 14:04:13.809732 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.809683 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac8083bb76a46a51cece9f7df8a199f65b81c3d8cf575948105c0621295c4aa"} err="failed to get container status \"dac8083bb76a46a51cece9f7df8a199f65b81c3d8cf575948105c0621295c4aa\": rpc error: code = NotFound desc = could not find container \"dac8083bb76a46a51cece9f7df8a199f65b81c3d8cf575948105c0621295c4aa\": container with ID starting with dac8083bb76a46a51cece9f7df8a199f65b81c3d8cf575948105c0621295c4aa not found: ID does not exist" Jul 09 14:04:13.815907 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.815865 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ggbmf" podStartSLOduration=1.2793884580000001 podStartE2EDuration="4.815851568s" totalImagesPullingTime="3.53646311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:13.814094954 +0000 UTC m=+352.990782247" watchObservedRunningTime="2026-07-09 14:04:13.815851568 +0000 UTC m=+352.992538888" Jul 09 14:04:13.832058 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.832013 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9zg7t" podStartSLOduration=1.311416035 podStartE2EDuration="4.831999021s" totalImagesPullingTime="3.520582986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:13.830934048 +0000 UTC m=+353.007621335" watchObservedRunningTime="2026-07-09 14:04:13.831999021 +0000 UTC m=+353.008686312" Jul 09 14:04:13.845813 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.845786 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz"] Jul 09 14:04:13.849799 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:13.849778 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cj9gz"] Jul 09 14:04:15.350844 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:15.350813 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="139eda35-98a3-4a0e-b59e-2e420e9c7ec8" path="/var/lib/kubelet/pods/139eda35-98a3-4a0e-b59e-2e420e9c7ec8/volumes" Jul 09 14:04:16.767860 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:16.767836 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-9klgb" Jul 09 14:04:16.769125 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:16.769102 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-j4j6m" Jul 09 14:04:44.807684 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:44.807639 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9zg7t" Jul 09 14:04:44.810539 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:44.810518 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ggbmf" Jul 09 14:04:58.683945 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:58.683911 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:58.788860 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:58.788821 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:58.835673 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:58.835629 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qv55p"] Jul 09 14:04:58.836157 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:58.836134 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="139eda35-98a3-4a0e-b59e-2e420e9c7ec8" containerName="discovery" Jul 09 14:04:58.836157 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:58.836156 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="139eda35-98a3-4a0e-b59e-2e420e9c7ec8" containerName="discovery" Jul 09 14:04:58.836348 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:58.836239 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="139eda35-98a3-4a0e-b59e-2e420e9c7ec8" containerName="discovery" Jul 09 14:04:58.838403 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:58.838382 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qv55p" Jul 09 14:04:58.841006 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:58.840981 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 14:04:58.841170 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:58.841150 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-fvbvg\"" Jul 09 14:04:58.842252 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:58.842234 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 14:04:58.849518 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:58.849499 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qv55p"] Jul 09 14:04:58.886025 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:58.885987 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:58.975924 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:58.975838 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5v9d\" (UniqueName: \"kubernetes.io/projected/7d5689cc-d7b0-4272-aa08-be0d4d96c7f6-kube-api-access-s5v9d\") pod \"kuadrant-operator-catalog-qv55p\" (UID: \"7d5689cc-d7b0-4272-aa08-be0d4d96c7f6\") " pod="kuadrant-system/kuadrant-operator-catalog-qv55p" Jul 09 14:04:59.076972 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:59.076934 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5v9d\" (UniqueName: \"kubernetes.io/projected/7d5689cc-d7b0-4272-aa08-be0d4d96c7f6-kube-api-access-s5v9d\") pod \"kuadrant-operator-catalog-qv55p\" (UID: \"7d5689cc-d7b0-4272-aa08-be0d4d96c7f6\") " pod="kuadrant-system/kuadrant-operator-catalog-qv55p" Jul 09 14:04:59.085828 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:59.085804 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5v9d\" (UniqueName: \"kubernetes.io/projected/7d5689cc-d7b0-4272-aa08-be0d4d96c7f6-kube-api-access-s5v9d\") pod \"kuadrant-operator-catalog-qv55p\" (UID: \"7d5689cc-d7b0-4272-aa08-be0d4d96c7f6\") " pod="kuadrant-system/kuadrant-operator-catalog-qv55p" Jul 09 14:04:59.149150 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:59.149112 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qv55p" Jul 09 14:04:59.192215 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:59.192178 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qv55p"] Jul 09 14:04:59.281256 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:59.281236 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qv55p"] Jul 09 14:04:59.283887 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:04:59.283859 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5689cc_d7b0_4272_aa08_be0d4d96c7f6.slice/crio-6a01c0b6a914e8b2ae5df5095a26501a6b681baf1193eeefc9f97709cb5cc78c WatchSource:0}: Error finding container 6a01c0b6a914e8b2ae5df5095a26501a6b681baf1193eeefc9f97709cb5cc78c: Status 404 returned error can't find the container with id 6a01c0b6a914e8b2ae5df5095a26501a6b681baf1193eeefc9f97709cb5cc78c Jul 09 14:04:59.403482 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:59.403447 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p9qv9"] Jul 09 14:04:59.406250 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:59.406233 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p9qv9" Jul 09 14:04:59.421569 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:59.421544 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p9qv9"] Jul 09 14:04:59.480730 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:59.480691 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r54k8\" (UniqueName: \"kubernetes.io/projected/72d919f5-f439-40f2-a711-82529a9eea55-kube-api-access-r54k8\") pod \"kuadrant-operator-catalog-p9qv9\" (UID: \"72d919f5-f439-40f2-a711-82529a9eea55\") " pod="kuadrant-system/kuadrant-operator-catalog-p9qv9" Jul 09 14:04:59.581715 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:59.581609 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r54k8\" (UniqueName: \"kubernetes.io/projected/72d919f5-f439-40f2-a711-82529a9eea55-kube-api-access-r54k8\") pod \"kuadrant-operator-catalog-p9qv9\" (UID: \"72d919f5-f439-40f2-a711-82529a9eea55\") " pod="kuadrant-system/kuadrant-operator-catalog-p9qv9" Jul 09 14:04:59.589993 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:59.589966 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r54k8\" (UniqueName: \"kubernetes.io/projected/72d919f5-f439-40f2-a711-82529a9eea55-kube-api-access-r54k8\") pod \"kuadrant-operator-catalog-p9qv9\" (UID: \"72d919f5-f439-40f2-a711-82529a9eea55\") " pod="kuadrant-system/kuadrant-operator-catalog-p9qv9" Jul 09 14:04:59.715484 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:59.715440 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p9qv9" Jul 09 14:04:59.881855 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:59.881821 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p9qv9"] Jul 09 14:04:59.940563 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:04:59.940500 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72d919f5_f439_40f2_a711_82529a9eea55.slice/crio-f9723670c545ac28436a40d538702d96a614dc8d3edb13bafdebe189379d2daf WatchSource:0}: Error finding container f9723670c545ac28436a40d538702d96a614dc8d3edb13bafdebe189379d2daf: Status 404 returned error can't find the container with id f9723670c545ac28436a40d538702d96a614dc8d3edb13bafdebe189379d2daf Jul 09 14:04:59.993009 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:59.992967 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p9qv9" event={"ID":"72d919f5-f439-40f2-a711-82529a9eea55","Type":"ContainerStarted","Data":"f9723670c545ac28436a40d538702d96a614dc8d3edb13bafdebe189379d2daf"} Jul 09 14:04:59.994286 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:04:59.994251 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qv55p" event={"ID":"7d5689cc-d7b0-4272-aa08-be0d4d96c7f6","Type":"ContainerStarted","Data":"6a01c0b6a914e8b2ae5df5095a26501a6b681baf1193eeefc9f97709cb5cc78c"} Jul 09 14:05:02.005236 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:02.005202 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p9qv9" event={"ID":"72d919f5-f439-40f2-a711-82529a9eea55","Type":"ContainerStarted","Data":"2f21e13f51a2c87d5cc5cd8569e507b1d532a0219c28762e63599242bd17ff8b"} Jul 09 14:05:02.006741 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:02.006702 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qv55p" event={"ID":"7d5689cc-d7b0-4272-aa08-be0d4d96c7f6","Type":"ContainerStarted","Data":"d486c355667386bb997078cc1fe10843fb3e542b8119cb7cdb765e7c66952184"} Jul 09 14:05:02.006875 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:02.006748 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-qv55p" podUID="7d5689cc-d7b0-4272-aa08-be0d4d96c7f6" containerName="registry-server" containerID="cri-o://d486c355667386bb997078cc1fe10843fb3e542b8119cb7cdb765e7c66952184" gracePeriod=2 Jul 09 14:05:02.024596 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:02.024545 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-p9qv9" podStartSLOduration=1.515246477 podStartE2EDuration="3.024528558s" totalImagesPullingTime="1.509282081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:05:02.024262483 +0000 UTC m=+401.200949777" watchObservedRunningTime="2026-07-09 14:05:02.024528558 +0000 UTC m=+401.201215849" Jul 09 14:05:02.041020 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:02.040972 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qv55p" podStartSLOduration=1.878179105 podStartE2EDuration="4.040956882s" totalImagesPullingTime="2.162777777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:05:02.039963294 +0000 UTC m=+401.216650589" watchObservedRunningTime="2026-07-09 14:05:02.040956882 +0000 UTC m=+401.217644171" Jul 09 14:05:02.241676 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:02.241634 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qv55p" Jul 09 14:05:02.311448 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:02.311359 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5v9d\" (UniqueName: \"kubernetes.io/projected/7d5689cc-d7b0-4272-aa08-be0d4d96c7f6-kube-api-access-s5v9d\") pod \"7d5689cc-d7b0-4272-aa08-be0d4d96c7f6\" (UID: \"7d5689cc-d7b0-4272-aa08-be0d4d96c7f6\") " Jul 09 14:05:02.313539 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:02.313509 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d5689cc-d7b0-4272-aa08-be0d4d96c7f6-kube-api-access-s5v9d" (OuterVolumeSpecName: "kube-api-access-s5v9d") pod "7d5689cc-d7b0-4272-aa08-be0d4d96c7f6" (UID: "7d5689cc-d7b0-4272-aa08-be0d4d96c7f6"). InnerVolumeSpecName "kube-api-access-s5v9d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:05:02.412364 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:02.412323 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5v9d\" (UniqueName: \"kubernetes.io/projected/7d5689cc-d7b0-4272-aa08-be0d4d96c7f6-kube-api-access-s5v9d\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:05:03.011901 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:03.011863 2565 generic.go:356] "Generic (PLEG): container finished" podID="7d5689cc-d7b0-4272-aa08-be0d4d96c7f6" containerID="d486c355667386bb997078cc1fe10843fb3e542b8119cb7cdb765e7c66952184" exitCode=0 Jul 09 14:05:03.011901 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:03.011905 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qv55p" Jul 09 14:05:03.012399 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:03.011954 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qv55p" event={"ID":"7d5689cc-d7b0-4272-aa08-be0d4d96c7f6","Type":"ContainerDied","Data":"d486c355667386bb997078cc1fe10843fb3e542b8119cb7cdb765e7c66952184"} Jul 09 14:05:03.012399 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:03.012001 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qv55p" event={"ID":"7d5689cc-d7b0-4272-aa08-be0d4d96c7f6","Type":"ContainerDied","Data":"6a01c0b6a914e8b2ae5df5095a26501a6b681baf1193eeefc9f97709cb5cc78c"} Jul 09 14:05:03.012399 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:03.012028 2565 scope.go:117] "RemoveContainer" containerID="d486c355667386bb997078cc1fe10843fb3e542b8119cb7cdb765e7c66952184" Jul 09 14:05:03.021300 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:03.021281 2565 scope.go:117] "RemoveContainer" containerID="d486c355667386bb997078cc1fe10843fb3e542b8119cb7cdb765e7c66952184" Jul 09 14:05:03.021602 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:05:03.021584 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d486c355667386bb997078cc1fe10843fb3e542b8119cb7cdb765e7c66952184\": container with ID starting with d486c355667386bb997078cc1fe10843fb3e542b8119cb7cdb765e7c66952184 not found: ID does not exist" containerID="d486c355667386bb997078cc1fe10843fb3e542b8119cb7cdb765e7c66952184" Jul 09 14:05:03.021663 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:03.021612 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d486c355667386bb997078cc1fe10843fb3e542b8119cb7cdb765e7c66952184"} err="failed to get container status \"d486c355667386bb997078cc1fe10843fb3e542b8119cb7cdb765e7c66952184\": rpc error: code = NotFound desc = could not find container \"d486c355667386bb997078cc1fe10843fb3e542b8119cb7cdb765e7c66952184\": container with ID starting with d486c355667386bb997078cc1fe10843fb3e542b8119cb7cdb765e7c66952184 not found: ID does not exist" Jul 09 14:05:03.036806 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:03.036772 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qv55p"] Jul 09 14:05:03.043547 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:03.043522 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qv55p"] Jul 09 14:05:03.350493 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:03.350464 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d5689cc-d7b0-4272-aa08-be0d4d96c7f6" path="/var/lib/kubelet/pods/7d5689cc-d7b0-4272-aa08-be0d4d96c7f6/volumes" Jul 09 14:05:09.716464 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:09.716426 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-p9qv9" Jul 09 14:05:09.716883 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:09.716487 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-p9qv9" Jul 09 14:05:09.739514 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:09.739476 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-p9qv9" Jul 09 14:05:10.061627 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:10.061548 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-p9qv9" Jul 09 14:05:28.007748 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:28.007714 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:31.883694 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:31.883607 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:33.340591 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:33.340557 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw"] Jul 09 14:05:33.341003 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:33.340886 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d5689cc-d7b0-4272-aa08-be0d4d96c7f6" containerName="registry-server" Jul 09 14:05:33.341003 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:33.340897 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d5689cc-d7b0-4272-aa08-be0d4d96c7f6" containerName="registry-server" Jul 09 14:05:33.341003 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:33.340960 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d5689cc-d7b0-4272-aa08-be0d4d96c7f6" containerName="registry-server" Jul 09 14:05:33.344583 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:33.344566 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:05:33.347630 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:33.347606 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f7n76\"" Jul 09 14:05:33.358054 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:33.358020 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw"] Jul 09 14:05:33.364989 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:33.364967 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78t5p\" (UniqueName: \"kubernetes.io/projected/ac031105-f8a9-4518-9944-61e97d7fec51-kube-api-access-78t5p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-59xkw\" (UID: \"ac031105-f8a9-4518-9944-61e97d7fec51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:05:33.365100 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:33.365021 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac031105-f8a9-4518-9944-61e97d7fec51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-59xkw\" (UID: \"ac031105-f8a9-4518-9944-61e97d7fec51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:05:33.465460 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:33.465423 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78t5p\" (UniqueName: \"kubernetes.io/projected/ac031105-f8a9-4518-9944-61e97d7fec51-kube-api-access-78t5p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-59xkw\" (UID: \"ac031105-f8a9-4518-9944-61e97d7fec51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:05:33.465669 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:33.465497 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac031105-f8a9-4518-9944-61e97d7fec51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-59xkw\" (UID: \"ac031105-f8a9-4518-9944-61e97d7fec51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:05:33.465862 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:33.465846 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac031105-f8a9-4518-9944-61e97d7fec51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-59xkw\" (UID: \"ac031105-f8a9-4518-9944-61e97d7fec51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:05:33.474023 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:33.474000 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78t5p\" (UniqueName: \"kubernetes.io/projected/ac031105-f8a9-4518-9944-61e97d7fec51-kube-api-access-78t5p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-59xkw\" (UID: \"ac031105-f8a9-4518-9944-61e97d7fec51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:05:33.639906 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:33.639877 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:33.654956 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:33.654931 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:05:33.801969 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:33.801942 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw"] Jul 09 14:05:33.803613 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:05:33.803588 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac031105_f8a9_4518_9944_61e97d7fec51.slice/crio-3a2bfd41cf91d41104776cb0babcb65429de788bcea684137505cd2928cf01eb WatchSource:0}: Error finding container 3a2bfd41cf91d41104776cb0babcb65429de788bcea684137505cd2928cf01eb: Status 404 returned error can't find the container with id 3a2bfd41cf91d41104776cb0babcb65429de788bcea684137505cd2928cf01eb Jul 09 14:05:34.137273 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:34.137240 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" event={"ID":"ac031105-f8a9-4518-9944-61e97d7fec51","Type":"ContainerStarted","Data":"3a2bfd41cf91d41104776cb0babcb65429de788bcea684137505cd2928cf01eb"} Jul 09 14:05:34.941234 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:34.941200 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-v2qdg"] Jul 09 14:05:34.943732 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:34.943716 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v2qdg" Jul 09 14:05:34.946734 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:34.946709 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 09 14:05:34.946865 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:34.946739 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-x6kqh\"" Jul 09 14:05:34.957148 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:34.957127 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-v2qdg"] Jul 09 14:05:34.978084 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:34.978054 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bktg6\" (UniqueName: \"kubernetes.io/projected/fcede6fc-a168-47fa-8baa-79e470fd55c5-kube-api-access-bktg6\") pod \"dns-operator-controller-manager-864dd78c4c-v2qdg\" (UID: \"fcede6fc-a168-47fa-8baa-79e470fd55c5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v2qdg" Jul 09 14:05:35.079266 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:35.079228 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bktg6\" (UniqueName: \"kubernetes.io/projected/fcede6fc-a168-47fa-8baa-79e470fd55c5-kube-api-access-bktg6\") pod \"dns-operator-controller-manager-864dd78c4c-v2qdg\" (UID: \"fcede6fc-a168-47fa-8baa-79e470fd55c5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v2qdg" Jul 09 14:05:35.089381 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:35.089350 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bktg6\" (UniqueName: \"kubernetes.io/projected/fcede6fc-a168-47fa-8baa-79e470fd55c5-kube-api-access-bktg6\") pod \"dns-operator-controller-manager-864dd78c4c-v2qdg\" (UID: \"fcede6fc-a168-47fa-8baa-79e470fd55c5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v2qdg" Jul 09 14:05:35.242964 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:35.242861 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:35.254716 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:35.254689 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v2qdg" Jul 09 14:05:35.445164 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:35.445130 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-v2qdg"] Jul 09 14:05:35.447750 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:05:35.447715 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcede6fc_a168_47fa_8baa_79e470fd55c5.slice/crio-af2bb27c8b7c555ed6cef010999cb474e083bc39843d38429e52df5d21b52ea4 WatchSource:0}: Error finding container af2bb27c8b7c555ed6cef010999cb474e083bc39843d38429e52df5d21b52ea4: Status 404 returned error can't find the container with id af2bb27c8b7c555ed6cef010999cb474e083bc39843d38429e52df5d21b52ea4 Jul 09 14:05:35.602499 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:35.602473 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:35.712801 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:35.712766 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:36.145904 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:36.145851 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v2qdg" event={"ID":"fcede6fc-a168-47fa-8baa-79e470fd55c5","Type":"ContainerStarted","Data":"af2bb27c8b7c555ed6cef010999cb474e083bc39843d38429e52df5d21b52ea4"} Jul 09 14:05:38.157635 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:38.157602 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v2qdg" event={"ID":"fcede6fc-a168-47fa-8baa-79e470fd55c5","Type":"ContainerStarted","Data":"7d54cabdb585a07539fac37858445b7f95adcb56877637078147ec76dbb9aefe"} Jul 09 14:05:38.158028 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:38.157700 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v2qdg" Jul 09 14:05:38.163813 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:38.163787 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5qcc9"] Jul 09 14:05:38.166133 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:38.166117 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qcc9" Jul 09 14:05:38.168585 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:38.168558 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5h4hl\"" Jul 09 14:05:38.176142 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:38.176118 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5qcc9"] Jul 09 14:05:38.179883 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:38.179843 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v2qdg" podStartSLOduration=1.98701742 podStartE2EDuration="4.179829729s" totalImagesPullingTime="2.192812309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:05:38.178662903 +0000 UTC m=+437.355350207" watchObservedRunningTime="2026-07-09 14:05:38.179829729 +0000 UTC m=+437.356517021" Jul 09 14:05:38.208400 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:38.208370 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-229vc\" (UniqueName: \"kubernetes.io/projected/d5f6e667-5ebe-411d-af17-52b92a6ace4e-kube-api-access-229vc\") pod \"authorino-operator-75cc8d5cb7-5qcc9\" (UID: \"d5f6e667-5ebe-411d-af17-52b92a6ace4e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qcc9" Jul 09 14:05:38.309038 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:38.308996 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-229vc\" (UniqueName: \"kubernetes.io/projected/d5f6e667-5ebe-411d-af17-52b92a6ace4e-kube-api-access-229vc\") pod \"authorino-operator-75cc8d5cb7-5qcc9\" (UID: \"d5f6e667-5ebe-411d-af17-52b92a6ace4e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qcc9" Jul 09 14:05:38.318994 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:38.318968 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-229vc\" (UniqueName: \"kubernetes.io/projected/d5f6e667-5ebe-411d-af17-52b92a6ace4e-kube-api-access-229vc\") pod \"authorino-operator-75cc8d5cb7-5qcc9\" (UID: \"d5f6e667-5ebe-411d-af17-52b92a6ace4e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qcc9" Jul 09 14:05:38.475902 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:38.475822 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qcc9" Jul 09 14:05:38.817960 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:38.817852 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:39.055632 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:39.055597 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:39.188776 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:39.188740 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:39.744811 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:39.744776 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5qcc9"] Jul 09 14:05:39.747144 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:05:39.747118 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f6e667_5ebe_411d_af17_52b92a6ace4e.slice/crio-4f7dbfc30629adbdaa36c7444974b35d21ceb70c4ca3cb1a060817034b0d0c67 WatchSource:0}: Error finding container 4f7dbfc30629adbdaa36c7444974b35d21ceb70c4ca3cb1a060817034b0d0c67: Status 404 returned error can't find the container with id 4f7dbfc30629adbdaa36c7444974b35d21ceb70c4ca3cb1a060817034b0d0c67 Jul 09 14:05:40.167861 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:40.167830 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" event={"ID":"ac031105-f8a9-4518-9944-61e97d7fec51","Type":"ContainerStarted","Data":"e94db1efdb4e97930747b05da43039bf15ee45ad9b6a87c7d26fbd2c5a4a8c54"} Jul 09 14:05:40.168051 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:40.167917 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:05:40.169457 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:40.169420 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qcc9" event={"ID":"d5f6e667-5ebe-411d-af17-52b92a6ace4e","Type":"ContainerStarted","Data":"4f7dbfc30629adbdaa36c7444974b35d21ceb70c4ca3cb1a060817034b0d0c67"} Jul 09 14:05:40.188869 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:40.188808 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" podStartSLOduration=1.350604564 podStartE2EDuration="7.188794847s" totalImagesPullingTime="5.838190283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:05:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:05:40.187304355 +0000 UTC m=+439.363991649" watchObservedRunningTime="2026-07-09 14:05:40.188794847 +0000 UTC m=+439.365482138" Jul 09 14:05:40.896241 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:40.896209 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk"] Jul 09 14:05:40.898540 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:40.898523 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" Jul 09 14:05:40.901065 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:40.901045 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5lgdn\"" Jul 09 14:05:40.908791 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:40.908770 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk"] Jul 09 14:05:40.934496 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:40.934470 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlkjp\" (UniqueName: \"kubernetes.io/projected/c57ccf79-0c84-4022-aeda-90cecb0a76a7-kube-api-access-hlkjp\") pod \"limitador-operator-controller-manager-859d7b78bd-bvwkk\" (UID: \"c57ccf79-0c84-4022-aeda-90cecb0a76a7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" Jul 09 14:05:41.035618 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:41.035586 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlkjp\" (UniqueName: \"kubernetes.io/projected/c57ccf79-0c84-4022-aeda-90cecb0a76a7-kube-api-access-hlkjp\") pod \"limitador-operator-controller-manager-859d7b78bd-bvwkk\" (UID: \"c57ccf79-0c84-4022-aeda-90cecb0a76a7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" Jul 09 14:05:41.044352 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:41.044320 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlkjp\" (UniqueName: \"kubernetes.io/projected/c57ccf79-0c84-4022-aeda-90cecb0a76a7-kube-api-access-hlkjp\") pod \"limitador-operator-controller-manager-859d7b78bd-bvwkk\" (UID: \"c57ccf79-0c84-4022-aeda-90cecb0a76a7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" Jul 09 14:05:41.209971 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:41.209883 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" Jul 09 14:05:41.337466 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:41.337431 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk"] Jul 09 14:05:41.339912 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:05:41.339883 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc57ccf79_0c84_4022_aeda_90cecb0a76a7.slice/crio-d97af760acdfcee95751a38fd4c6e15e5f4cb7366997bbdcf231ebbf9cddccdb WatchSource:0}: Error finding container d97af760acdfcee95751a38fd4c6e15e5f4cb7366997bbdcf231ebbf9cddccdb: Status 404 returned error can't find the container with id d97af760acdfcee95751a38fd4c6e15e5f4cb7366997bbdcf231ebbf9cddccdb Jul 09 14:05:42.111557 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:42.111517 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:42.181303 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:42.181259 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" event={"ID":"c57ccf79-0c84-4022-aeda-90cecb0a76a7","Type":"ContainerStarted","Data":"d97af760acdfcee95751a38fd4c6e15e5f4cb7366997bbdcf231ebbf9cddccdb"} Jul 09 14:05:42.588771 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:42.588670 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9mh5j"] Jul 09 14:05:42.600484 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:42.600454 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9mh5j" Jul 09 14:05:42.602033 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:42.601990 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9mh5j"] Jul 09 14:05:42.602538 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:42.602515 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:42.603955 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:42.603924 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 09 14:05:42.604055 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:42.604015 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ddbx2\"" Jul 09 14:05:42.604055 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:42.604027 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 09 14:05:42.649449 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:42.649231 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cm8k\" (UniqueName: \"kubernetes.io/projected/b6be5a43-98bb-4622-8c11-6899c94bcdfa-kube-api-access-5cm8k\") pod \"kuadrant-console-plugin-66b5774985-9mh5j\" (UID: \"b6be5a43-98bb-4622-8c11-6899c94bcdfa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9mh5j" Jul 09 14:05:42.649449 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:42.649299 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6be5a43-98bb-4622-8c11-6899c94bcdfa-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9mh5j\" (UID: \"b6be5a43-98bb-4622-8c11-6899c94bcdfa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9mh5j" Jul 09 14:05:42.649449 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:42.649341 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b6be5a43-98bb-4622-8c11-6899c94bcdfa-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9mh5j\" (UID: \"b6be5a43-98bb-4622-8c11-6899c94bcdfa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9mh5j" Jul 09 14:05:42.750843 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:42.750809 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cm8k\" (UniqueName: \"kubernetes.io/projected/b6be5a43-98bb-4622-8c11-6899c94bcdfa-kube-api-access-5cm8k\") pod \"kuadrant-console-plugin-66b5774985-9mh5j\" (UID: \"b6be5a43-98bb-4622-8c11-6899c94bcdfa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9mh5j" Jul 09 14:05:42.751041 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:42.750860 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6be5a43-98bb-4622-8c11-6899c94bcdfa-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9mh5j\" (UID: \"b6be5a43-98bb-4622-8c11-6899c94bcdfa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9mh5j" Jul 09 14:05:42.751041 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:42.750883 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b6be5a43-98bb-4622-8c11-6899c94bcdfa-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9mh5j\" (UID: \"b6be5a43-98bb-4622-8c11-6899c94bcdfa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9mh5j" Jul 09 14:05:42.751041 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:05:42.750987 2565 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 09 14:05:42.751191 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:05:42.751069 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6be5a43-98bb-4622-8c11-6899c94bcdfa-plugin-serving-cert podName:b6be5a43-98bb-4622-8c11-6899c94bcdfa nodeName:}" failed. No retries permitted until 2026-07-09 14:05:43.251048323 +0000 UTC m=+442.427735596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/b6be5a43-98bb-4622-8c11-6899c94bcdfa-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-9mh5j" (UID: "b6be5a43-98bb-4622-8c11-6899c94bcdfa") : secret "plugin-serving-cert" not found Jul 09 14:05:42.751579 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:42.751553 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b6be5a43-98bb-4622-8c11-6899c94bcdfa-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9mh5j\" (UID: \"b6be5a43-98bb-4622-8c11-6899c94bcdfa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9mh5j" Jul 09 14:05:42.762950 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:42.762926 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cm8k\" (UniqueName: \"kubernetes.io/projected/b6be5a43-98bb-4622-8c11-6899c94bcdfa-kube-api-access-5cm8k\") pod \"kuadrant-console-plugin-66b5774985-9mh5j\" (UID: \"b6be5a43-98bb-4622-8c11-6899c94bcdfa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9mh5j" Jul 09 14:05:42.840040 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:42.839964 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:43.020035 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:43.019939 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:43.120068 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:43.120024 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:43.255840 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:43.255808 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6be5a43-98bb-4622-8c11-6899c94bcdfa-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9mh5j\" (UID: \"b6be5a43-98bb-4622-8c11-6899c94bcdfa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9mh5j" Jul 09 14:05:43.258414 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:43.258388 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6be5a43-98bb-4622-8c11-6899c94bcdfa-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9mh5j\" (UID: \"b6be5a43-98bb-4622-8c11-6899c94bcdfa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9mh5j" Jul 09 14:05:43.378249 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:43.378154 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:43.477857 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:43.477825 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:43.514541 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:43.514508 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9mh5j" Jul 09 14:05:44.192602 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:44.192553 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" event={"ID":"c57ccf79-0c84-4022-aeda-90cecb0a76a7","Type":"ContainerStarted","Data":"7a0f2ee01f50ccd755c18ce9fd62543969318fc83ec007411797e13d211db0f0"} Jul 09 14:05:44.193060 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:44.192627 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" Jul 09 14:05:44.194400 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:44.194373 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qcc9" event={"ID":"d5f6e667-5ebe-411d-af17-52b92a6ace4e","Type":"ContainerStarted","Data":"626b1f5abca4999354069f39121b6858a420d0a179d4daea492cf3ea3ba1765a"} Jul 09 14:05:44.194536 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:44.194470 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qcc9" Jul 09 14:05:44.209403 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:44.209355 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" podStartSLOduration=1.474627173 podStartE2EDuration="4.209338863s" totalImagesPullingTime="2.73471169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:05:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:05:44.207977405 +0000 UTC m=+443.384664708" watchObservedRunningTime="2026-07-09 14:05:44.209338863 +0000 UTC m=+443.386026154" Jul 09 14:05:44.214301 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:44.214274 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9mh5j"] Jul 09 14:05:44.217350 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:05:44.217328 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6be5a43_98bb_4622_8c11_6899c94bcdfa.slice/crio-427314ccecd8ee9efc8ab838adf5883f47f13b9cbeafe06e0aff386d1ca83d92 WatchSource:0}: Error finding container 427314ccecd8ee9efc8ab838adf5883f47f13b9cbeafe06e0aff386d1ca83d92: Status 404 returned error can't find the container with id 427314ccecd8ee9efc8ab838adf5883f47f13b9cbeafe06e0aff386d1ca83d92 Jul 09 14:05:44.228246 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:44.228191 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qcc9" podStartSLOduration=1.893562067 podStartE2EDuration="6.228175007s" totalImagesPullingTime="4.33461294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:05:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:05:44.228134456 +0000 UTC m=+443.404821747" watchObservedRunningTime="2026-07-09 14:05:44.228175007 +0000 UTC m=+443.404862298" Jul 09 14:05:45.200465 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:45.200396 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9mh5j" event={"ID":"b6be5a43-98bb-4622-8c11-6899c94bcdfa","Type":"ContainerStarted","Data":"427314ccecd8ee9efc8ab838adf5883f47f13b9cbeafe06e0aff386d1ca83d92"} Jul 09 14:05:49.165017 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:49.164982 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-v2qdg" Jul 09 14:05:50.619060 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:50.619004 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:50.778022 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:50.777967 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:51.176306 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:51.176275 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:05:52.888202 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.888170 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw"] Jul 09 14:05:52.889064 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.888415 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" podUID="ac031105-f8a9-4518-9944-61e97d7fec51" containerName="manager" containerID="cri-o://e94db1efdb4e97930747b05da43039bf15ee45ad9b6a87c7d26fbd2c5a4a8c54" gracePeriod=2 Jul 09 14:05:52.890540 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.890508 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw"] Jul 09 14:05:52.890786 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:05:52.890752 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-59xkw\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="ac031105-f8a9-4518-9944-61e97d7fec51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:05:52.899014 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.898986 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk"] Jul 09 14:05:52.899307 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.899279 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" podUID="c57ccf79-0c84-4022-aeda-90cecb0a76a7" containerName="manager" containerID="cri-o://7a0f2ee01f50ccd755c18ce9fd62543969318fc83ec007411797e13d211db0f0" gracePeriod=2 Jul 09 14:05:52.902088 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:05:52.901816 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-59xkw\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="ac031105-f8a9-4518-9944-61e97d7fec51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:05:52.902212 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.902147 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" Jul 09 14:05:52.908039 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.908013 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk"] Jul 09 14:05:52.910787 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:05:52.910745 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-59xkw\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="ac031105-f8a9-4518-9944-61e97d7fec51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:05:52.911664 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.911626 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2"] Jul 09 14:05:52.912150 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.912126 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac031105-f8a9-4518-9944-61e97d7fec51" containerName="manager" Jul 09 14:05:52.912150 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.912152 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac031105-f8a9-4518-9944-61e97d7fec51" containerName="manager" Jul 09 14:05:52.912318 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.912164 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c57ccf79-0c84-4022-aeda-90cecb0a76a7" containerName="manager" Jul 09 14:05:52.912318 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.912171 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c57ccf79-0c84-4022-aeda-90cecb0a76a7" containerName="manager" Jul 09 14:05:52.912318 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.912281 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c57ccf79-0c84-4022-aeda-90cecb0a76a7" containerName="manager" Jul 09 14:05:52.912318 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.912291 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac031105-f8a9-4518-9944-61e97d7fec51" containerName="manager" Jul 09 14:05:52.912749 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:05:52.912706 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bvwkk\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="c57ccf79-0c84-4022-aeda-90cecb0a76a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" Jul 09 14:05:52.914667 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.914627 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2" Jul 09 14:05:52.916872 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:05:52.916831 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-59xkw\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="ac031105-f8a9-4518-9944-61e97d7fec51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:05:52.918909 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:05:52.918865 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bvwkk\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="c57ccf79-0c84-4022-aeda-90cecb0a76a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" Jul 09 14:05:52.925280 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.925215 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2"] Jul 09 14:05:52.930061 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.930040 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x27zh"] Jul 09 14:05:52.933235 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.932957 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x27zh" Jul 09 14:05:52.949753 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:52.949536 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x27zh"] Jul 09 14:05:52.964845 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:05:52.964807 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-59xkw\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="ac031105-f8a9-4518-9944-61e97d7fec51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:05:52.966838 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:05:52.966798 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bvwkk\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="c57ccf79-0c84-4022-aeda-90cecb0a76a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" Jul 09 14:05:53.049095 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:53.049055 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g8kk\" (UniqueName: \"kubernetes.io/projected/074cc6d8-c520-4e7b-8702-82ed0c5ecd9f-kube-api-access-5g8kk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wkvs2\" (UID: \"074cc6d8-c520-4e7b-8702-82ed0c5ecd9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2" Jul 09 14:05:53.049274 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:53.049148 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/074cc6d8-c520-4e7b-8702-82ed0c5ecd9f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wkvs2\" (UID: \"074cc6d8-c520-4e7b-8702-82ed0c5ecd9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2" Jul 09 14:05:53.049274 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:53.049184 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8dkj\" (UniqueName: \"kubernetes.io/projected/a189f6a6-725d-47e4-8542-a59f1504a766-kube-api-access-k8dkj\") pod \"limitador-operator-controller-manager-859d7b78bd-x27zh\" (UID: \"a189f6a6-725d-47e4-8542-a59f1504a766\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x27zh" Jul 09 14:05:53.149835 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:53.149738 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g8kk\" (UniqueName: \"kubernetes.io/projected/074cc6d8-c520-4e7b-8702-82ed0c5ecd9f-kube-api-access-5g8kk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wkvs2\" (UID: \"074cc6d8-c520-4e7b-8702-82ed0c5ecd9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2" Jul 09 14:05:53.149835 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:53.149821 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/074cc6d8-c520-4e7b-8702-82ed0c5ecd9f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wkvs2\" (UID: \"074cc6d8-c520-4e7b-8702-82ed0c5ecd9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2" Jul 09 14:05:53.150131 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:53.149852 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8dkj\" (UniqueName: \"kubernetes.io/projected/a189f6a6-725d-47e4-8542-a59f1504a766-kube-api-access-k8dkj\") pod \"limitador-operator-controller-manager-859d7b78bd-x27zh\" (UID: \"a189f6a6-725d-47e4-8542-a59f1504a766\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x27zh" Jul 09 14:05:53.150249 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:53.150225 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/074cc6d8-c520-4e7b-8702-82ed0c5ecd9f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wkvs2\" (UID: \"074cc6d8-c520-4e7b-8702-82ed0c5ecd9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2" Jul 09 14:05:53.158895 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:53.158861 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8dkj\" (UniqueName: \"kubernetes.io/projected/a189f6a6-725d-47e4-8542-a59f1504a766-kube-api-access-k8dkj\") pod \"limitador-operator-controller-manager-859d7b78bd-x27zh\" (UID: \"a189f6a6-725d-47e4-8542-a59f1504a766\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x27zh" Jul 09 14:05:53.159042 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:53.158910 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g8kk\" (UniqueName: \"kubernetes.io/projected/074cc6d8-c520-4e7b-8702-82ed0c5ecd9f-kube-api-access-5g8kk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wkvs2\" (UID: \"074cc6d8-c520-4e7b-8702-82ed0c5ecd9f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2" Jul 09 14:05:53.324040 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:53.324006 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2" Jul 09 14:05:53.331923 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:53.331896 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x27zh" Jul 09 14:05:53.942548 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:53.942509 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94"] Jul 09 14:05:53.947369 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:53.947347 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94" Jul 09 14:05:53.959987 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:53.959959 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94"] Jul 09 14:05:54.057289 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:54.057250 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2dnx\" (UniqueName: \"kubernetes.io/projected/d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7-kube-api-access-r2dnx\") pod \"kuadrant-operator-controller-manager-86878c769f-4jv94\" (UID: \"d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94" Jul 09 14:05:54.057483 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:54.057304 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4jv94\" (UID: \"d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94" Jul 09 14:05:54.158636 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:54.158601 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2dnx\" (UniqueName: \"kubernetes.io/projected/d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7-kube-api-access-r2dnx\") pod \"kuadrant-operator-controller-manager-86878c769f-4jv94\" (UID: \"d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94" Jul 09 14:05:54.158841 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:54.158677 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4jv94\" (UID: \"d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94" Jul 09 14:05:54.159126 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:54.159103 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4jv94\" (UID: \"d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94" Jul 09 14:05:54.170834 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:54.170807 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2dnx\" (UniqueName: \"kubernetes.io/projected/d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7-kube-api-access-r2dnx\") pod \"kuadrant-operator-controller-manager-86878c769f-4jv94\" (UID: \"d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94" Jul 09 14:05:54.261489 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:54.261402 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94" Jul 09 14:05:55.202999 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:55.202967 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qcc9" Jul 09 14:05:56.126212 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:56.126181 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:56.227304 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:56.227262 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:56.451926 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:56.451836 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:56.552203 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:56.552165 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:59.439296 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:59.439242 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:59.539912 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:05:59.539876 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:03.232195 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:03.232148 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:03.296162 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:03.296132 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:07.638211 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:07.638186 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:06:07.640859 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:06:07.640823 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-59xkw\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="ac031105-f8a9-4518-9944-61e97d7fec51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:06:07.641541 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:07.641524 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" Jul 09 14:06:07.643670 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:06:07.643627 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-59xkw\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="ac031105-f8a9-4518-9944-61e97d7fec51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:06:07.645803 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:06:07.645777 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bvwkk\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="c57ccf79-0c84-4022-aeda-90cecb0a76a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" Jul 09 14:06:07.733320 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:07.733289 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x27zh"] Jul 09 14:06:07.736080 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:06:07.736055 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda189f6a6_725d_47e4_8542_a59f1504a766.slice/crio-25c32d93523243d634d61f2f6cb263e929138ff522c5deacbcdfd8007d8cf2d7 WatchSource:0}: Error finding container 25c32d93523243d634d61f2f6cb263e929138ff522c5deacbcdfd8007d8cf2d7: Status 404 returned error can't find the container with id 25c32d93523243d634d61f2f6cb263e929138ff522c5deacbcdfd8007d8cf2d7 Jul 09 14:06:07.736510 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:07.736484 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94"] Jul 09 14:06:07.739195 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:07.739169 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2"] Jul 09 14:06:07.739880 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:06:07.739838 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9cdf495_6ca5_4848_97f9_2e9fb23bb3f7.slice/crio-d071ec630a3851ef18ed0ae97f6561f7358ba52d513a874b58ffce5a6353bfc0 WatchSource:0}: Error finding container d071ec630a3851ef18ed0ae97f6561f7358ba52d513a874b58ffce5a6353bfc0: Status 404 returned error can't find the container with id d071ec630a3851ef18ed0ae97f6561f7358ba52d513a874b58ffce5a6353bfc0 Jul 09 14:06:07.741954 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:06:07.741857 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod074cc6d8_c520_4e7b_8702_82ed0c5ecd9f.slice/crio-83b193bd943136c8fa85c63e0a1b2539a6f10a72ab5fea1d63f154b50201cb03 WatchSource:0}: Error finding container 83b193bd943136c8fa85c63e0a1b2539a6f10a72ab5fea1d63f154b50201cb03: Status 404 returned error can't find the container with id 83b193bd943136c8fa85c63e0a1b2539a6f10a72ab5fea1d63f154b50201cb03 Jul 09 14:06:07.788702 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:07.788677 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac031105-f8a9-4518-9944-61e97d7fec51-extensions-socket-volume\") pod \"ac031105-f8a9-4518-9944-61e97d7fec51\" (UID: \"ac031105-f8a9-4518-9944-61e97d7fec51\") " Jul 09 14:06:07.788829 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:07.788714 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlkjp\" (UniqueName: \"kubernetes.io/projected/c57ccf79-0c84-4022-aeda-90cecb0a76a7-kube-api-access-hlkjp\") pod \"c57ccf79-0c84-4022-aeda-90cecb0a76a7\" (UID: \"c57ccf79-0c84-4022-aeda-90cecb0a76a7\") " Jul 09 14:06:07.788829 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:07.788746 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78t5p\" (UniqueName: \"kubernetes.io/projected/ac031105-f8a9-4518-9944-61e97d7fec51-kube-api-access-78t5p\") pod \"ac031105-f8a9-4518-9944-61e97d7fec51\" (UID: \"ac031105-f8a9-4518-9944-61e97d7fec51\") " Jul 09 14:06:07.789233 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:07.789208 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac031105-f8a9-4518-9944-61e97d7fec51-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ac031105-f8a9-4518-9944-61e97d7fec51" (UID: "ac031105-f8a9-4518-9944-61e97d7fec51"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:06:07.790722 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:07.790688 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac031105-f8a9-4518-9944-61e97d7fec51-kube-api-access-78t5p" (OuterVolumeSpecName: "kube-api-access-78t5p") pod "ac031105-f8a9-4518-9944-61e97d7fec51" (UID: "ac031105-f8a9-4518-9944-61e97d7fec51"). InnerVolumeSpecName "kube-api-access-78t5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:06:07.790797 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:07.790756 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c57ccf79-0c84-4022-aeda-90cecb0a76a7-kube-api-access-hlkjp" (OuterVolumeSpecName: "kube-api-access-hlkjp") pod "c57ccf79-0c84-4022-aeda-90cecb0a76a7" (UID: "c57ccf79-0c84-4022-aeda-90cecb0a76a7"). InnerVolumeSpecName "kube-api-access-hlkjp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:06:07.889572 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:07.889545 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac031105-f8a9-4518-9944-61e97d7fec51-extensions-socket-volume\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:06:07.889572 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:07.889572 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlkjp\" (UniqueName: \"kubernetes.io/projected/c57ccf79-0c84-4022-aeda-90cecb0a76a7-kube-api-access-hlkjp\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:06:07.889572 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:07.889582 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78t5p\" (UniqueName: \"kubernetes.io/projected/ac031105-f8a9-4518-9944-61e97d7fec51-kube-api-access-78t5p\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:06:08.321262 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.321189 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9mh5j" event={"ID":"b6be5a43-98bb-4622-8c11-6899c94bcdfa","Type":"ContainerStarted","Data":"58878cae983e1c6d0c824535f1a10620cfd3b4fddeb9e1a7b7a6823a379d16a2"} Jul 09 14:06:08.322862 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.322837 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94" event={"ID":"d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7","Type":"ContainerStarted","Data":"9243afc64b03a60e2dd853bce5380fe26862ed945a23b016be752f4c25a673c0"} Jul 09 14:06:08.322987 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.322878 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94" event={"ID":"d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7","Type":"ContainerStarted","Data":"d071ec630a3851ef18ed0ae97f6561f7358ba52d513a874b58ffce5a6353bfc0"} Jul 09 14:06:08.322987 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.322898 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94" Jul 09 14:06:08.323836 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:06:08.323800 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bvwkk\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="c57ccf79-0c84-4022-aeda-90cecb0a76a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" Jul 09 14:06:08.324571 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.324550 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2" event={"ID":"074cc6d8-c520-4e7b-8702-82ed0c5ecd9f","Type":"ContainerStarted","Data":"05eb6d372c580e6bb432dcb3dd3114f072b05a07f1d2cd609dadc540b2ffacf4"} Jul 09 14:06:08.324697 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.324588 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2" event={"ID":"074cc6d8-c520-4e7b-8702-82ed0c5ecd9f","Type":"ContainerStarted","Data":"83b193bd943136c8fa85c63e0a1b2539a6f10a72ab5fea1d63f154b50201cb03"} Jul 09 14:06:08.324697 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.324641 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2" Jul 09 14:06:08.325819 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.325794 2565 generic.go:356] "Generic (PLEG): container finished" podID="c57ccf79-0c84-4022-aeda-90cecb0a76a7" containerID="7a0f2ee01f50ccd755c18ce9fd62543969318fc83ec007411797e13d211db0f0" exitCode=0 Jul 09 14:06:08.325914 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:06:08.325810 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-59xkw\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="ac031105-f8a9-4518-9944-61e97d7fec51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:06:08.325914 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.325831 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" Jul 09 14:06:08.325914 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.325884 2565 scope.go:117] "RemoveContainer" containerID="7a0f2ee01f50ccd755c18ce9fd62543969318fc83ec007411797e13d211db0f0" Jul 09 14:06:08.327592 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.327565 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x27zh" event={"ID":"a189f6a6-725d-47e4-8542-a59f1504a766","Type":"ContainerStarted","Data":"3ee6403d6ade3e1423fd7598267e6df5f981be532a090f37e08c7f09474ff76f"} Jul 09 14:06:08.327703 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.327622 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x27zh" Jul 09 14:06:08.327703 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.327675 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x27zh" event={"ID":"a189f6a6-725d-47e4-8542-a59f1504a766","Type":"ContainerStarted","Data":"25c32d93523243d634d61f2f6cb263e929138ff522c5deacbcdfd8007d8cf2d7"} Jul 09 14:06:08.329044 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.329024 2565 generic.go:356] "Generic (PLEG): container finished" podID="ac031105-f8a9-4518-9944-61e97d7fec51" containerID="e94db1efdb4e97930747b05da43039bf15ee45ad9b6a87c7d26fbd2c5a4a8c54" exitCode=0 Jul 09 14:06:08.329151 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.329100 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:06:08.343132 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.343091 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9mh5j" podStartSLOduration=2.90314627 podStartE2EDuration="26.34307808s" totalImagesPullingTime="23.43993181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:05:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:06:08.341559651 +0000 UTC m=+467.518246944" watchObservedRunningTime="2026-07-09 14:06:08.34307808 +0000 UTC m=+467.519765371" Jul 09 14:06:08.343809 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.343669 2565 scope.go:117] "RemoveContainer" containerID="7a0f2ee01f50ccd755c18ce9fd62543969318fc83ec007411797e13d211db0f0" Jul 09 14:06:08.343977 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:06:08.343952 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a0f2ee01f50ccd755c18ce9fd62543969318fc83ec007411797e13d211db0f0\": container with ID starting with 7a0f2ee01f50ccd755c18ce9fd62543969318fc83ec007411797e13d211db0f0 not found: ID does not exist" containerID="7a0f2ee01f50ccd755c18ce9fd62543969318fc83ec007411797e13d211db0f0" Jul 09 14:06:08.344026 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.343985 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a0f2ee01f50ccd755c18ce9fd62543969318fc83ec007411797e13d211db0f0"} err="failed to get container status \"7a0f2ee01f50ccd755c18ce9fd62543969318fc83ec007411797e13d211db0f0\": rpc error: code = NotFound desc = could not find container \"7a0f2ee01f50ccd755c18ce9fd62543969318fc83ec007411797e13d211db0f0\": container with ID starting with 7a0f2ee01f50ccd755c18ce9fd62543969318fc83ec007411797e13d211db0f0 not found: ID does not exist" Jul 09 14:06:08.344026 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.344003 2565 scope.go:117] "RemoveContainer" containerID="e94db1efdb4e97930747b05da43039bf15ee45ad9b6a87c7d26fbd2c5a4a8c54" Jul 09 14:06:08.352004 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.351984 2565 scope.go:117] "RemoveContainer" containerID="e94db1efdb4e97930747b05da43039bf15ee45ad9b6a87c7d26fbd2c5a4a8c54" Jul 09 14:06:08.352319 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:06:08.352298 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e94db1efdb4e97930747b05da43039bf15ee45ad9b6a87c7d26fbd2c5a4a8c54\": container with ID starting with e94db1efdb4e97930747b05da43039bf15ee45ad9b6a87c7d26fbd2c5a4a8c54 not found: ID does not exist" containerID="e94db1efdb4e97930747b05da43039bf15ee45ad9b6a87c7d26fbd2c5a4a8c54" Jul 09 14:06:08.352382 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.352325 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e94db1efdb4e97930747b05da43039bf15ee45ad9b6a87c7d26fbd2c5a4a8c54"} err="failed to get container status \"e94db1efdb4e97930747b05da43039bf15ee45ad9b6a87c7d26fbd2c5a4a8c54\": rpc error: code = NotFound desc = could not find container \"e94db1efdb4e97930747b05da43039bf15ee45ad9b6a87c7d26fbd2c5a4a8c54\": container with ID starting with e94db1efdb4e97930747b05da43039bf15ee45ad9b6a87c7d26fbd2c5a4a8c54 not found: ID does not exist" Jul 09 14:06:08.358199 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.358151 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x27zh" podStartSLOduration=16.358135912 podStartE2EDuration="16.358135912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:05:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:06:08.357946987 +0000 UTC m=+467.534634282" watchObservedRunningTime="2026-07-09 14:06:08.358135912 +0000 UTC m=+467.534823206" Jul 09 14:06:08.377749 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.377700 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94" podStartSLOduration=15.377686322 podStartE2EDuration="15.377686322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:05:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:06:08.376078359 +0000 UTC m=+467.552765670" watchObservedRunningTime="2026-07-09 14:06:08.377686322 +0000 UTC m=+467.554373615" Jul 09 14:06:08.378103 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:06:08.378080 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-59xkw\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="ac031105-f8a9-4518-9944-61e97d7fec51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:06:08.379925 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:06:08.379901 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bvwkk\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="c57ccf79-0c84-4022-aeda-90cecb0a76a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" Jul 09 14:06:08.398108 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:06:08.398073 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-59xkw\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="ac031105-f8a9-4518-9944-61e97d7fec51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-59xkw" Jul 09 14:06:08.398226 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:08.398135 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2" podStartSLOduration=16.398121912 podStartE2EDuration="16.398121912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:05:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:06:08.396102434 +0000 UTC m=+467.572789730" watchObservedRunningTime="2026-07-09 14:06:08.398121912 +0000 UTC m=+467.574809273" Jul 09 14:06:08.400081 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:06:08.400055 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bvwkk\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="c57ccf79-0c84-4022-aeda-90cecb0a76a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvwkk" Jul 09 14:06:09.351553 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:09.351518 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac031105-f8a9-4518-9944-61e97d7fec51" path="/var/lib/kubelet/pods/ac031105-f8a9-4518-9944-61e97d7fec51/volumes" Jul 09 14:06:09.352015 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:09.351874 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c57ccf79-0c84-4022-aeda-90cecb0a76a7" path="/var/lib/kubelet/pods/c57ccf79-0c84-4022-aeda-90cecb0a76a7/volumes" Jul 09 14:06:09.596693 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:09.596641 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:09.697066 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:09.696968 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:16.165813 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:16.165779 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:16.266857 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:16.266769 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:19.160187 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:19.160159 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:19.262952 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:19.262925 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:19.337429 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:19.337385 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x27zh" Jul 09 14:06:19.337596 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:19.337463 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2" Jul 09 14:06:19.337664 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:19.337596 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94" Jul 09 14:06:19.438890 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:19.438808 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2"] Jul 09 14:06:19.439077 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:19.439003 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2" podUID="074cc6d8-c520-4e7b-8702-82ed0c5ecd9f" containerName="manager" containerID="cri-o://05eb6d372c580e6bb432dcb3dd3114f072b05a07f1d2cd609dadc540b2ffacf4" gracePeriod=10 Jul 09 14:06:19.695734 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:19.695673 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2" Jul 09 14:06:19.787928 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:19.787898 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5g8kk\" (UniqueName: \"kubernetes.io/projected/074cc6d8-c520-4e7b-8702-82ed0c5ecd9f-kube-api-access-5g8kk\") pod \"074cc6d8-c520-4e7b-8702-82ed0c5ecd9f\" (UID: \"074cc6d8-c520-4e7b-8702-82ed0c5ecd9f\") " Jul 09 14:06:19.789843 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:19.789807 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/074cc6d8-c520-4e7b-8702-82ed0c5ecd9f-kube-api-access-5g8kk" (OuterVolumeSpecName: "kube-api-access-5g8kk") pod "074cc6d8-c520-4e7b-8702-82ed0c5ecd9f" (UID: "074cc6d8-c520-4e7b-8702-82ed0c5ecd9f"). InnerVolumeSpecName "kube-api-access-5g8kk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:06:19.888594 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:19.888565 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/074cc6d8-c520-4e7b-8702-82ed0c5ecd9f-extensions-socket-volume\") pod \"074cc6d8-c520-4e7b-8702-82ed0c5ecd9f\" (UID: \"074cc6d8-c520-4e7b-8702-82ed0c5ecd9f\") " Jul 09 14:06:19.888809 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:19.888796 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g8kk\" (UniqueName: \"kubernetes.io/projected/074cc6d8-c520-4e7b-8702-82ed0c5ecd9f-kube-api-access-5g8kk\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:06:19.888968 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:19.888945 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/074cc6d8-c520-4e7b-8702-82ed0c5ecd9f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "074cc6d8-c520-4e7b-8702-82ed0c5ecd9f" (UID: "074cc6d8-c520-4e7b-8702-82ed0c5ecd9f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:06:19.989572 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:19.989485 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/074cc6d8-c520-4e7b-8702-82ed0c5ecd9f-extensions-socket-volume\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:06:20.385844 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:20.385804 2565 generic.go:356] "Generic (PLEG): container finished" podID="074cc6d8-c520-4e7b-8702-82ed0c5ecd9f" containerID="05eb6d372c580e6bb432dcb3dd3114f072b05a07f1d2cd609dadc540b2ffacf4" exitCode=0 Jul 09 14:06:20.386215 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:20.385851 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2" Jul 09 14:06:20.386215 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:20.385891 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2" event={"ID":"074cc6d8-c520-4e7b-8702-82ed0c5ecd9f","Type":"ContainerDied","Data":"05eb6d372c580e6bb432dcb3dd3114f072b05a07f1d2cd609dadc540b2ffacf4"} Jul 09 14:06:20.386215 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:20.385945 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2" event={"ID":"074cc6d8-c520-4e7b-8702-82ed0c5ecd9f","Type":"ContainerDied","Data":"83b193bd943136c8fa85c63e0a1b2539a6f10a72ab5fea1d63f154b50201cb03"} Jul 09 14:06:20.386215 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:20.385974 2565 scope.go:117] "RemoveContainer" containerID="05eb6d372c580e6bb432dcb3dd3114f072b05a07f1d2cd609dadc540b2ffacf4" Jul 09 14:06:20.394841 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:20.394822 2565 scope.go:117] "RemoveContainer" containerID="05eb6d372c580e6bb432dcb3dd3114f072b05a07f1d2cd609dadc540b2ffacf4" Jul 09 14:06:20.395132 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:06:20.395106 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05eb6d372c580e6bb432dcb3dd3114f072b05a07f1d2cd609dadc540b2ffacf4\": container with ID starting with 05eb6d372c580e6bb432dcb3dd3114f072b05a07f1d2cd609dadc540b2ffacf4 not found: ID does not exist" containerID="05eb6d372c580e6bb432dcb3dd3114f072b05a07f1d2cd609dadc540b2ffacf4" Jul 09 14:06:20.395180 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:20.395136 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05eb6d372c580e6bb432dcb3dd3114f072b05a07f1d2cd609dadc540b2ffacf4"} err="failed to get container status \"05eb6d372c580e6bb432dcb3dd3114f072b05a07f1d2cd609dadc540b2ffacf4\": rpc error: code = NotFound desc = could not find container \"05eb6d372c580e6bb432dcb3dd3114f072b05a07f1d2cd609dadc540b2ffacf4\": container with ID starting with 05eb6d372c580e6bb432dcb3dd3114f072b05a07f1d2cd609dadc540b2ffacf4 not found: ID does not exist" Jul 09 14:06:20.410695 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:20.410667 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2"] Jul 09 14:06:20.416417 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:20.416392 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wkvs2"] Jul 09 14:06:21.351215 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:21.351180 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="074cc6d8-c520-4e7b-8702-82ed0c5ecd9f" path="/var/lib/kubelet/pods/074cc6d8-c520-4e7b-8702-82ed0c5ecd9f/volumes" Jul 09 14:06:23.355741 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:23.355705 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:23.411154 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:23.411123 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:32.556095 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:32.556059 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:32.656809 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:32.656778 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:35.821329 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:35.821272 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:36.004292 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:36.004260 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:37.757220 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:37.757178 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:37.806834 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:37.806804 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:38.293936 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:38.293897 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:06:38.294242 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:38.294220 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="074cc6d8-c520-4e7b-8702-82ed0c5ecd9f" containerName="manager" Jul 09 14:06:38.294242 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:38.294235 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="074cc6d8-c520-4e7b-8702-82ed0c5ecd9f" containerName="manager" Jul 09 14:06:38.294522 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:38.294302 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="074cc6d8-c520-4e7b-8702-82ed0c5ecd9f" containerName="manager" Jul 09 14:06:38.477663 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:38.477620 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:06:38.477663 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:38.477672 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:06:38.477899 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:38.477733 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-4tcff" Jul 09 14:06:38.480303 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:38.480276 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 14:06:38.540027 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:38.539987 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbcvj\" (UniqueName: \"kubernetes.io/projected/765da97e-6541-4498-88a3-459dd6f4d49d-kube-api-access-fbcvj\") pod \"limitador-limitador-54d6d988d5-4tcff\" (UID: \"765da97e-6541-4498-88a3-459dd6f4d49d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4tcff" Jul 09 14:06:38.540027 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:38.540030 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/765da97e-6541-4498-88a3-459dd6f4d49d-config-file\") pod \"limitador-limitador-54d6d988d5-4tcff\" (UID: \"765da97e-6541-4498-88a3-459dd6f4d49d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4tcff" Jul 09 14:06:38.641137 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:38.641104 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbcvj\" (UniqueName: \"kubernetes.io/projected/765da97e-6541-4498-88a3-459dd6f4d49d-kube-api-access-fbcvj\") pod \"limitador-limitador-54d6d988d5-4tcff\" (UID: \"765da97e-6541-4498-88a3-459dd6f4d49d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4tcff" Jul 09 14:06:38.641302 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:38.641142 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/765da97e-6541-4498-88a3-459dd6f4d49d-config-file\") pod \"limitador-limitador-54d6d988d5-4tcff\" (UID: \"765da97e-6541-4498-88a3-459dd6f4d49d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4tcff" Jul 09 14:06:38.641779 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:38.641761 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/765da97e-6541-4498-88a3-459dd6f4d49d-config-file\") pod \"limitador-limitador-54d6d988d5-4tcff\" (UID: \"765da97e-6541-4498-88a3-459dd6f4d49d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4tcff" Jul 09 14:06:38.663961 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:38.663935 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbcvj\" (UniqueName: \"kubernetes.io/projected/765da97e-6541-4498-88a3-459dd6f4d49d-kube-api-access-fbcvj\") pod \"limitador-limitador-54d6d988d5-4tcff\" (UID: \"765da97e-6541-4498-88a3-459dd6f4d49d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4tcff" Jul 09 14:06:38.787906 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:38.787872 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-4tcff" Jul 09 14:06:38.894208 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:38.893959 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:38.924513 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:38.924492 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:06:38.926113 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:06:38.926081 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod765da97e_6541_4498_88a3_459dd6f4d49d.slice/crio-ef05a1208e18bc834186d323ef10621a01fad24d6e7478f25b904b00eb485a49 WatchSource:0}: Error finding container ef05a1208e18bc834186d323ef10621a01fad24d6e7478f25b904b00eb485a49: Status 404 returned error can't find the container with id ef05a1208e18bc834186d323ef10621a01fad24d6e7478f25b904b00eb485a49 Jul 09 14:06:38.994293 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:38.994264 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:39.476070 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:39.476027 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-4tcff" event={"ID":"765da97e-6541-4498-88a3-459dd6f4d49d","Type":"ContainerStarted","Data":"ef05a1208e18bc834186d323ef10621a01fad24d6e7478f25b904b00eb485a49"} Jul 09 14:06:41.486941 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:41.486901 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-4tcff" event={"ID":"765da97e-6541-4498-88a3-459dd6f4d49d","Type":"ContainerStarted","Data":"168eb6a2fdda3d5ca112bfd985e92481b5f33bc4c19ee3e185da60277f448d83"} Jul 09 14:06:41.487392 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:41.487031 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-4tcff" Jul 09 14:06:41.504097 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:41.503913 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-4tcff" podStartSLOduration=1.094928949 podStartE2EDuration="3.503898921s" totalImagesPullingTime="2.408969972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:06:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:06:41.50367936 +0000 UTC m=+500.680366652" watchObservedRunningTime="2026-07-09 14:06:41.503898921 +0000 UTC m=+500.680586212" Jul 09 14:06:42.565119 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:42.565089 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:42.665169 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:42.665131 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:52.492466 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:52.492436 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-4tcff" Jul 09 14:06:53.982797 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:53.982768 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:54.081883 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:54.081845 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:54.466059 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:06:54.466026 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:06.801324 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:07:06.801292 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:06.965810 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:07:06.965776 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:13.236251 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:07:13.236171 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:13.337118 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:07:13.337087 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:13.440287 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:07:13.440250 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:13.501961 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:07:13.501871 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:19.016562 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:07:19.016496 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:19.127679 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:07:19.127628 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:40.458342 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:07:40.458310 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:42.381337 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:07:42.381307 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:50.385313 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:07:50.385283 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:50.863781 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:07:50.863747 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:51.119942 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:07:51.119857 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:51.308030 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:07:51.307996 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:51.374518 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:07:51.374443 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:51.577268 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:07:51.577234 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:08:01.737318 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:01.737287 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:01.831285 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:01.831251 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:08.422519 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:08.422485 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:08.474966 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:08.474937 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:09.241094 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:09.241067 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:09.824026 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:09.823990 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:08:21.230906 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:21.230878 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 14:08:21.235339 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:21.235318 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 14:08:23.626467 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:23.626433 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:26.722264 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:26.722227 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:27.529375 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:27.529343 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:08:34.620169 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.620137 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm"] Jul 09 14:08:34.622826 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.622801 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.626766 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.626730 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cjpmt\"" Jul 09 14:08:34.626766 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.626763 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 14:08:34.626979 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.626731 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 14:08:34.626979 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.626855 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 09 14:08:34.634922 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.634890 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm"] Jul 09 14:08:34.655342 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.655314 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:34.723952 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.723908 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/362faee8-9f0b-4716-a780-2489c60fef78-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km4vm\" (UID: \"362faee8-9f0b-4716-a780-2489c60fef78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.724125 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.723978 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/362faee8-9f0b-4716-a780-2489c60fef78-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km4vm\" (UID: \"362faee8-9f0b-4716-a780-2489c60fef78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.724125 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.724010 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/362faee8-9f0b-4716-a780-2489c60fef78-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km4vm\" (UID: \"362faee8-9f0b-4716-a780-2489c60fef78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.724125 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.724037 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t76fd\" (UniqueName: \"kubernetes.io/projected/362faee8-9f0b-4716-a780-2489c60fef78-kube-api-access-t76fd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km4vm\" (UID: \"362faee8-9f0b-4716-a780-2489c60fef78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.724125 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.724107 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/362faee8-9f0b-4716-a780-2489c60fef78-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km4vm\" (UID: \"362faee8-9f0b-4716-a780-2489c60fef78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.724125 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.724121 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/362faee8-9f0b-4716-a780-2489c60fef78-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km4vm\" (UID: \"362faee8-9f0b-4716-a780-2489c60fef78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.824879 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.824836 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/362faee8-9f0b-4716-a780-2489c60fef78-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km4vm\" (UID: \"362faee8-9f0b-4716-a780-2489c60fef78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.825066 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.824908 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/362faee8-9f0b-4716-a780-2489c60fef78-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km4vm\" (UID: \"362faee8-9f0b-4716-a780-2489c60fef78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.825066 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.824942 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/362faee8-9f0b-4716-a780-2489c60fef78-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km4vm\" (UID: \"362faee8-9f0b-4716-a780-2489c60fef78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.825066 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.824970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t76fd\" (UniqueName: \"kubernetes.io/projected/362faee8-9f0b-4716-a780-2489c60fef78-kube-api-access-t76fd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km4vm\" (UID: \"362faee8-9f0b-4716-a780-2489c60fef78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.825066 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.825052 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/362faee8-9f0b-4716-a780-2489c60fef78-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km4vm\" (UID: \"362faee8-9f0b-4716-a780-2489c60fef78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.825264 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.825077 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/362faee8-9f0b-4716-a780-2489c60fef78-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km4vm\" (UID: \"362faee8-9f0b-4716-a780-2489c60fef78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.825368 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.825343 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/362faee8-9f0b-4716-a780-2489c60fef78-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km4vm\" (UID: \"362faee8-9f0b-4716-a780-2489c60fef78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.825431 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.825404 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/362faee8-9f0b-4716-a780-2489c60fef78-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km4vm\" (UID: \"362faee8-9f0b-4716-a780-2489c60fef78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.825485 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.825449 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/362faee8-9f0b-4716-a780-2489c60fef78-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km4vm\" (UID: \"362faee8-9f0b-4716-a780-2489c60fef78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.827216 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.827187 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/362faee8-9f0b-4716-a780-2489c60fef78-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km4vm\" (UID: \"362faee8-9f0b-4716-a780-2489c60fef78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.827455 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.827437 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/362faee8-9f0b-4716-a780-2489c60fef78-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km4vm\" (UID: \"362faee8-9f0b-4716-a780-2489c60fef78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.833964 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.833941 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t76fd\" (UniqueName: \"kubernetes.io/projected/362faee8-9f0b-4716-a780-2489c60fef78-kube-api-access-t76fd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km4vm\" (UID: \"362faee8-9f0b-4716-a780-2489c60fef78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:34.934411 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:34.934327 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:35.069890 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:35.069754 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm"] Jul 09 14:08:35.073688 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:08:35.073334 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod362faee8_9f0b_4716_a780_2489c60fef78.slice/crio-13e2e9be44e95eced6ea5130b2cd06b1537d44c0c24ddde3d604ce3a0b769dec WatchSource:0}: Error finding container 13e2e9be44e95eced6ea5130b2cd06b1537d44c0c24ddde3d604ce3a0b769dec: Status 404 returned error can't find the container with id 13e2e9be44e95eced6ea5130b2cd06b1537d44c0c24ddde3d604ce3a0b769dec Jul 09 14:08:35.075193 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:35.075170 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:08:36.002460 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:36.002420 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" event={"ID":"362faee8-9f0b-4716-a780-2489c60fef78","Type":"ContainerStarted","Data":"13e2e9be44e95eced6ea5130b2cd06b1537d44c0c24ddde3d604ce3a0b769dec"} Jul 09 14:08:36.126189 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:36.126156 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:08:37.008544 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:37.008502 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" event={"ID":"362faee8-9f0b-4716-a780-2489c60fef78","Type":"ContainerStarted","Data":"3065e5efbc0208884db5f93b8d2388bbb1637d86e03e4f89b33b2d664be7b311"} Jul 09 14:08:37.029620 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:37.029567 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" podStartSLOduration=1.919584237 podStartE2EDuration="3.029549876s" totalImagesPullingTime="1.109965639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:08:37.027780301 +0000 UTC m=+616.204467598" watchObservedRunningTime="2026-07-09 14:08:37.029549876 +0000 UTC m=+616.206237167" Jul 09 14:08:41.042197 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:41.042152 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:42.725864 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:42.725833 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:08:44.934682 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:44.934617 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:44.935092 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:44.934714 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:44.947292 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:44.947265 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:45.055354 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:45.055326 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km4vm" Jul 09 14:08:52.641706 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.641636 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll"] Jul 09 14:08:52.645548 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.645521 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.648112 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.648093 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 09 14:08:52.652186 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.652162 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll"] Jul 09 14:08:52.665529 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.665488 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:52.781953 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.781915 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3feac139-dd34-4909-946d-3a36a30f2269-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8gdll\" (UID: \"3feac139-dd34-4909-946d-3a36a30f2269\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.782130 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.781966 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3feac139-dd34-4909-946d-3a36a30f2269-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8gdll\" (UID: \"3feac139-dd34-4909-946d-3a36a30f2269\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.782130 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.782046 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3feac139-dd34-4909-946d-3a36a30f2269-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8gdll\" (UID: \"3feac139-dd34-4909-946d-3a36a30f2269\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.782130 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.782079 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6p5q\" (UniqueName: \"kubernetes.io/projected/3feac139-dd34-4909-946d-3a36a30f2269-kube-api-access-p6p5q\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8gdll\" (UID: \"3feac139-dd34-4909-946d-3a36a30f2269\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.782130 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.782098 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3feac139-dd34-4909-946d-3a36a30f2269-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8gdll\" (UID: \"3feac139-dd34-4909-946d-3a36a30f2269\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.782130 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.782116 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3feac139-dd34-4909-946d-3a36a30f2269-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8gdll\" (UID: \"3feac139-dd34-4909-946d-3a36a30f2269\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.883364 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.883324 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6p5q\" (UniqueName: \"kubernetes.io/projected/3feac139-dd34-4909-946d-3a36a30f2269-kube-api-access-p6p5q\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8gdll\" (UID: \"3feac139-dd34-4909-946d-3a36a30f2269\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.883364 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.883362 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3feac139-dd34-4909-946d-3a36a30f2269-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8gdll\" (UID: \"3feac139-dd34-4909-946d-3a36a30f2269\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.883601 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.883393 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3feac139-dd34-4909-946d-3a36a30f2269-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8gdll\" (UID: \"3feac139-dd34-4909-946d-3a36a30f2269\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.883601 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.883426 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3feac139-dd34-4909-946d-3a36a30f2269-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8gdll\" (UID: \"3feac139-dd34-4909-946d-3a36a30f2269\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.883601 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.883475 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3feac139-dd34-4909-946d-3a36a30f2269-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8gdll\" (UID: \"3feac139-dd34-4909-946d-3a36a30f2269\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.883601 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.883528 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3feac139-dd34-4909-946d-3a36a30f2269-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8gdll\" (UID: \"3feac139-dd34-4909-946d-3a36a30f2269\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.883857 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.883779 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3feac139-dd34-4909-946d-3a36a30f2269-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8gdll\" (UID: \"3feac139-dd34-4909-946d-3a36a30f2269\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.883912 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.883856 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3feac139-dd34-4909-946d-3a36a30f2269-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8gdll\" (UID: \"3feac139-dd34-4909-946d-3a36a30f2269\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.883912 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.883893 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3feac139-dd34-4909-946d-3a36a30f2269-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8gdll\" (UID: \"3feac139-dd34-4909-946d-3a36a30f2269\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.885836 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.885816 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3feac139-dd34-4909-946d-3a36a30f2269-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8gdll\" (UID: \"3feac139-dd34-4909-946d-3a36a30f2269\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.885984 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.885965 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3feac139-dd34-4909-946d-3a36a30f2269-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8gdll\" (UID: \"3feac139-dd34-4909-946d-3a36a30f2269\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.890758 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.890735 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6p5q\" (UniqueName: \"kubernetes.io/projected/3feac139-dd34-4909-946d-3a36a30f2269-kube-api-access-p6p5q\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8gdll\" (UID: \"3feac139-dd34-4909-946d-3a36a30f2269\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:52.957291 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:52.957203 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:08:53.093898 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:53.093871 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll"] Jul 09 14:08:53.095812 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:08:53.095786 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3feac139_dd34_4909_946d_3a36a30f2269.slice/crio-e2a910071c165c234fcf025a9a8ef62145a102127e1449163fba61e67e07030c WatchSource:0}: Error finding container e2a910071c165c234fcf025a9a8ef62145a102127e1449163fba61e67e07030c: Status 404 returned error can't find the container with id e2a910071c165c234fcf025a9a8ef62145a102127e1449163fba61e67e07030c Jul 09 14:08:54.089187 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:54.089151 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" event={"ID":"3feac139-dd34-4909-946d-3a36a30f2269","Type":"ContainerStarted","Data":"105e329f50b8b41f5636bb94c7525097553edd20a2f77c17522adcbf658663ab"} Jul 09 14:08:54.089691 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:54.089201 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" event={"ID":"3feac139-dd34-4909-946d-3a36a30f2269","Type":"ContainerStarted","Data":"e2a910071c165c234fcf025a9a8ef62145a102127e1449163fba61e67e07030c"} Jul 09 14:08:54.106926 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:54.106874 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" podStartSLOduration=1.8518226740000001 podStartE2EDuration="2.106859579s" totalImagesPullingTime="255.036905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:08:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:08:54.105055279 +0000 UTC m=+633.281742570" watchObservedRunningTime="2026-07-09 14:08:54.106859579 +0000 UTC m=+633.283546870" Jul 09 14:08:54.933850 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:08:54.933814 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:09:02.957593 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:02.957539 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:09:02.958072 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:02.957628 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:09:02.970273 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:02.970244 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:09:03.141997 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:03.141965 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8gdll" Jul 09 14:09:09.528506 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.528466 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6"] Jul 09 14:09:09.534697 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.534673 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.537228 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.537208 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 09 14:09:09.541217 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.541191 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6"] Jul 09 14:09:09.556076 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.556045 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:09.631389 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.631351 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6\" (UID: \"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.631560 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.631418 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6\" (UID: \"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.631560 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.631445 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6\" (UID: \"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.631560 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.631460 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kktqw\" (UniqueName: \"kubernetes.io/projected/2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46-kube-api-access-kktqw\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6\" (UID: \"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.631560 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.631481 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6\" (UID: \"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.631738 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.631555 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6\" (UID: \"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.732180 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.732147 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6\" (UID: \"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.732180 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.732183 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kktqw\" (UniqueName: \"kubernetes.io/projected/2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46-kube-api-access-kktqw\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6\" (UID: \"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.732397 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.732204 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6\" (UID: \"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.732397 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.732239 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6\" (UID: \"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.732397 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.732272 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6\" (UID: \"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.732397 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.732354 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6\" (UID: \"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.732599 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.732581 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6\" (UID: \"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.732672 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.732636 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6\" (UID: \"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.732672 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.732663 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6\" (UID: \"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.734633 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.734606 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6\" (UID: \"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.734805 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.734678 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6\" (UID: \"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.741430 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.741397 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kktqw\" (UniqueName: \"kubernetes.io/projected/2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46-kube-api-access-kktqw\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6\" (UID: \"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.845452 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.845360 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:09.981082 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:09.981055 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6"] Jul 09 14:09:09.983136 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:09:09.983109 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a6b5ba1_7322_4e0b_8d4f_99faf82c5f46.slice/crio-1904b42420a418ae3d0b228857f92b7e053b784c93b1f3afcfb385ec4d1da33f WatchSource:0}: Error finding container 1904b42420a418ae3d0b228857f92b7e053b784c93b1f3afcfb385ec4d1da33f: Status 404 returned error can't find the container with id 1904b42420a418ae3d0b228857f92b7e053b784c93b1f3afcfb385ec4d1da33f Jul 09 14:09:10.162441 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:10.162407 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" event={"ID":"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46","Type":"ContainerStarted","Data":"1904b42420a418ae3d0b228857f92b7e053b784c93b1f3afcfb385ec4d1da33f"} Jul 09 14:09:11.168964 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:11.168925 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" event={"ID":"2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46","Type":"ContainerStarted","Data":"e8949aae6481745704e061793e59dff80f97ea9c74779bb39faeef36710f1823"} Jul 09 14:09:11.187489 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:11.187439 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" podStartSLOduration=1.967189033 podStartE2EDuration="2.18742548s" totalImagesPullingTime="220.236447ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:09:11.185818055 +0000 UTC m=+650.362505346" watchObservedRunningTime="2026-07-09 14:09:11.18742548 +0000 UTC m=+650.364112775" Jul 09 14:09:11.945795 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:11.945753 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:09:19.846142 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:19.846099 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:19.846522 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:19.846158 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:19.858796 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:19.858767 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:20.221808 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:20.221775 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6" Jul 09 14:09:45.980440 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:45.980398 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:46.039964 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:09:46.039934 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:10:01.463504 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:10:01.463472 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:10:04.065346 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:10:04.065313 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:10:04.123221 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:10:04.123185 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:10:07.917348 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:10:07.917314 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:10:08.019008 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:10:08.018976 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:10:09.021269 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:10:09.021231 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:10:09.120140 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:10:09.120105 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:10:22.140715 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:10:22.140565 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:10:22.197783 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:10:22.197752 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:10:36.344769 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:10:36.344735 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:10:37.040787 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:10:37.040751 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:10:47.531361 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:10:47.531327 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:10:57.727699 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:10:57.727664 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:11:06.823004 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:11:06.822968 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:11:18.128817 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:11:18.128784 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:11:20.023601 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:11:20.023567 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:21.391476 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:11:21.391443 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:46.420628 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:11:46.420547 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:11:59.520862 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:11:59.520831 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:12:04.477763 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:12:04.477726 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:04.565436 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:12:04.565390 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:04.671929 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:12:04.671892 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:10.385012 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:12:10.384979 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:10.492194 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:12:10.492162 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:10.585930 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:12:10.585894 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:10.752271 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:12:10.752192 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:16.456145 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:12:16.456112 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:16.556143 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:12:16.556109 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:33.529161 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:12:33.529126 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:12:43.326367 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:12:43.326334 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:12:53.523664 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:12:53.523609 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:13:01.326718 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:13:01.326680 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:13:11.530520 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:13:11.530489 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:13:21.260395 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:13:21.260322 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 14:13:21.261791 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:13:21.261765 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 14:13:21.471578 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:13:21.471540 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:13:32.518246 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:13:32.518210 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:13:42.231393 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:13:42.231356 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:14:04.853477 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:14:04.853443 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:14:17.429163 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:14:17.429120 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:14:39.572049 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:14:39.572021 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:14:41.645672 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:14:41.645601 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:14:51.938941 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:14:51.938861 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:15:07.841316 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:15:07.841280 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:15:16.721823 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:15:16.721767 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:15:19.029003 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:15:19.028973 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:15:28.636794 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:15:28.636761 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:15:38.233251 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:15:38.233213 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:15:47.522252 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:15:47.522219 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:16:13.523755 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:13.523682 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94"] Jul 09 14:16:13.524269 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:13.523915 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94" podUID="d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7" containerName="manager" containerID="cri-o://9243afc64b03a60e2dd853bce5380fe26862ed945a23b016be752f4c25a673c0" gracePeriod=10 Jul 09 14:16:15.873942 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:15.873914 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94" Jul 09 14:16:16.018173 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:16.018084 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7-extensions-socket-volume\") pod \"d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7\" (UID: \"d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7\") " Jul 09 14:16:16.018173 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:16.018146 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2dnx\" (UniqueName: \"kubernetes.io/projected/d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7-kube-api-access-r2dnx\") pod \"d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7\" (UID: \"d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7\") " Jul 09 14:16:16.018492 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:16.018463 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7" (UID: "d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:16:16.020173 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:16.020155 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7-kube-api-access-r2dnx" (OuterVolumeSpecName: "kube-api-access-r2dnx") pod "d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7" (UID: "d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7"). InnerVolumeSpecName "kube-api-access-r2dnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:16:16.119087 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:16.119050 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7-extensions-socket-volume\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:16:16.119087 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:16.119082 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2dnx\" (UniqueName: \"kubernetes.io/projected/d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7-kube-api-access-r2dnx\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:16:16.150268 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:16.150231 2565 generic.go:356] "Generic (PLEG): container finished" podID="d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7" containerID="9243afc64b03a60e2dd853bce5380fe26862ed945a23b016be752f4c25a673c0" exitCode=0 Jul 09 14:16:16.150442 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:16.150276 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94" Jul 09 14:16:16.150442 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:16.150302 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94" event={"ID":"d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7","Type":"ContainerDied","Data":"9243afc64b03a60e2dd853bce5380fe26862ed945a23b016be752f4c25a673c0"} Jul 09 14:16:16.150442 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:16.150355 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94" event={"ID":"d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7","Type":"ContainerDied","Data":"d071ec630a3851ef18ed0ae97f6561f7358ba52d513a874b58ffce5a6353bfc0"} Jul 09 14:16:16.150442 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:16.150377 2565 scope.go:117] "RemoveContainer" containerID="9243afc64b03a60e2dd853bce5380fe26862ed945a23b016be752f4c25a673c0" Jul 09 14:16:16.160034 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:16.160018 2565 scope.go:117] "RemoveContainer" containerID="9243afc64b03a60e2dd853bce5380fe26862ed945a23b016be752f4c25a673c0" Jul 09 14:16:16.160283 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:16:16.160264 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9243afc64b03a60e2dd853bce5380fe26862ed945a23b016be752f4c25a673c0\": container with ID starting with 9243afc64b03a60e2dd853bce5380fe26862ed945a23b016be752f4c25a673c0 not found: ID does not exist" containerID="9243afc64b03a60e2dd853bce5380fe26862ed945a23b016be752f4c25a673c0" Jul 09 14:16:16.160349 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:16.160297 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9243afc64b03a60e2dd853bce5380fe26862ed945a23b016be752f4c25a673c0"} err="failed to get container status \"9243afc64b03a60e2dd853bce5380fe26862ed945a23b016be752f4c25a673c0\": rpc error: code = NotFound desc = could not find container \"9243afc64b03a60e2dd853bce5380fe26862ed945a23b016be752f4c25a673c0\": container with ID starting with 9243afc64b03a60e2dd853bce5380fe26862ed945a23b016be752f4c25a673c0 not found: ID does not exist" Jul 09 14:16:16.174114 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:16.174092 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94"] Jul 09 14:16:16.175857 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:16.175836 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jv94"] Jul 09 14:16:17.353440 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:16:17.353404 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7" path="/var/lib/kubelet/pods/d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7/volumes" Jul 09 14:17:14.830587 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:14.830552 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5v6cz"] Jul 09 14:17:14.831065 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:14.830910 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7" containerName="manager" Jul 09 14:17:14.831065 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:14.830922 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7" containerName="manager" Jul 09 14:17:14.831065 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:14.830990 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9cdf495-6ca5-4848-97f9-2e9fb23bb3f7" containerName="manager" Jul 09 14:17:14.833822 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:14.833805 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5v6cz" Jul 09 14:17:14.836641 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:14.836618 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f7n76\"" Jul 09 14:17:14.851712 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:14.851688 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5v6cz"] Jul 09 14:17:14.939214 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:14.939184 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g57ch\" (UniqueName: \"kubernetes.io/projected/68768865-f104-4923-be78-76f12e641b41-kube-api-access-g57ch\") pod \"kuadrant-operator-controller-manager-86878c769f-5v6cz\" (UID: \"68768865-f104-4923-be78-76f12e641b41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5v6cz" Jul 09 14:17:14.939394 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:14.939253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68768865-f104-4923-be78-76f12e641b41-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5v6cz\" (UID: \"68768865-f104-4923-be78-76f12e641b41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5v6cz" Jul 09 14:17:15.040412 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:15.040373 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g57ch\" (UniqueName: \"kubernetes.io/projected/68768865-f104-4923-be78-76f12e641b41-kube-api-access-g57ch\") pod \"kuadrant-operator-controller-manager-86878c769f-5v6cz\" (UID: \"68768865-f104-4923-be78-76f12e641b41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5v6cz" Jul 09 14:17:15.040603 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:15.040535 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68768865-f104-4923-be78-76f12e641b41-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5v6cz\" (UID: \"68768865-f104-4923-be78-76f12e641b41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5v6cz" Jul 09 14:17:15.040895 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:15.040879 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68768865-f104-4923-be78-76f12e641b41-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5v6cz\" (UID: \"68768865-f104-4923-be78-76f12e641b41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5v6cz" Jul 09 14:17:15.052132 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:15.052109 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g57ch\" (UniqueName: \"kubernetes.io/projected/68768865-f104-4923-be78-76f12e641b41-kube-api-access-g57ch\") pod \"kuadrant-operator-controller-manager-86878c769f-5v6cz\" (UID: \"68768865-f104-4923-be78-76f12e641b41\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5v6cz" Jul 09 14:17:15.143870 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:15.143833 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5v6cz" Jul 09 14:17:15.287128 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:15.286960 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5v6cz"] Jul 09 14:17:15.289755 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:17:15.289727 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68768865_f104_4923_be78_76f12e641b41.slice/crio-e8c605e971cdc38ddfd8018ad28855a2fcdc4e5c36ba99a8e6951c51a9a3375c WatchSource:0}: Error finding container e8c605e971cdc38ddfd8018ad28855a2fcdc4e5c36ba99a8e6951c51a9a3375c: Status 404 returned error can't find the container with id e8c605e971cdc38ddfd8018ad28855a2fcdc4e5c36ba99a8e6951c51a9a3375c Jul 09 14:17:15.427749 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:15.427622 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5v6cz" event={"ID":"68768865-f104-4923-be78-76f12e641b41","Type":"ContainerStarted","Data":"154f7b4f2776609548e10cf3ce8d36bf3d24ba84919913ca869c84d4f11a223f"} Jul 09 14:17:15.427749 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:15.427701 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5v6cz" event={"ID":"68768865-f104-4923-be78-76f12e641b41","Type":"ContainerStarted","Data":"e8c605e971cdc38ddfd8018ad28855a2fcdc4e5c36ba99a8e6951c51a9a3375c"} Jul 09 14:17:15.427970 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:15.427806 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5v6cz" Jul 09 14:17:15.447509 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:15.447457 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5v6cz" podStartSLOduration=1.447440825 podStartE2EDuration="1.447440825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:17:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:17:15.446025112 +0000 UTC m=+1134.622712427" watchObservedRunningTime="2026-07-09 14:17:15.447440825 +0000 UTC m=+1134.624128161" Jul 09 14:17:26.435045 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:26.435016 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5v6cz" Jul 09 14:17:35.828933 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:35.828899 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:17:44.931375 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:44.931298 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:17:52.943059 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:52.943021 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:17:57.334922 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:17:57.334886 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:18:09.430755 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:18:09.430719 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:18:21.124754 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:18:21.124717 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:18:21.298061 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:18:21.298031 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 14:18:21.298266 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:18:21.298162 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 14:18:30.828373 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:18:30.828337 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:18:39.926400 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:18:39.926357 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:18:50.532292 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:18:50.532259 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:19:02.146065 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:19:02.146006 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:19:04.297402 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:19:04.297367 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:19:04.363401 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:19:04.363370 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:19:11.736753 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:19:11.736713 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:19:21.931120 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:19:21.931036 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:19:44.242810 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:19:44.242774 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:19:54.030724 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:19:54.030690 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:20:03.736170 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:20:03.736135 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:20:14.725448 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:20:14.725416 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:20:20.675358 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:20:20.675321 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:20:21.327899 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:20:21.327862 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:20:22.185089 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:20:22.185054 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:20:30.735966 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:20:30.735932 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:20:42.931878 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:20:42.931793 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:20:52.424121 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:20:52.424084 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:21:02.332222 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:21:02.332187 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:21:06.532021 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:21:06.531958 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:21:06.589223 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:21:06.589180 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:21:11.856782 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:21:11.856750 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:21:21.429673 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:21:21.429612 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:21:35.138723 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:21:35.138687 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:21:44.239098 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:21:44.239060 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:21:48.191497 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:21:48.191459 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:21:53.526940 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:21:53.526904 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:22:05.952785 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:22:05.952747 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:22:17.734892 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:22:17.734807 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:22:26.938273 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:22:26.938239 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:22:39.727695 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:22:39.727659 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:22:51.436158 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:22:51.436123 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:23:03.831464 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:03.831427 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:23:08.011112 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:08.011069 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:08.204762 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:08.204716 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:08.519064 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:08.519029 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:14.299762 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:14.299724 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:14.361019 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:14.360979 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:14.526944 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:14.526908 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:14.595119 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:14.595020 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:15.629277 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:15.629234 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:15.795981 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:15.795950 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:15.901678 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:15.901573 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:16.151095 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:16.151066 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:16.334085 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:16.333999 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:16.437929 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:16.437896 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:18.285223 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:18.285195 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:18.431022 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:18.430974 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:23:20.772203 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:20.772168 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:20.958092 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:20.958054 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:21.199621 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:21.199588 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:21.270603 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:21.270563 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:21.324530 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:21.324498 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 14:23:21.327468 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:21.327447 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 14:23:24.744207 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:24.744127 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:26.882300 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:26.882267 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:26.983409 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:26.983372 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:27.207737 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:27.207629 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:27.307002 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:27.306971 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:23:27.327270 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:27.327244 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:27.431021 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:27.430988 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:27.527989 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:27.527895 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:28.609386 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:28.609348 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:28.725506 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:28.725461 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:28.873142 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:28.873063 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:29.210285 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:29.210195 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:29.312402 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:29.312370 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:31.059415 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:31.059383 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:33.250082 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:33.250042 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:33.449909 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:33.449843 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:33.552551 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:33.552432 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:33.677073 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:33.677039 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:35.073007 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:35.072979 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:38.329525 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:38.329484 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:39.382888 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:39.382856 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:39.488998 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:39.488963 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:39.620168 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:39.620131 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:39.720207 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:39.720106 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:40.719811 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:40.719773 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:40.836558 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:40.836523 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:40.933276 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:40.933242 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:41.211709 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:41.211672 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:41.420710 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:41.420674 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:41.520179 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:41.520087 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:43.232114 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:43.232072 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:43.639936 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:43.639906 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:23:46.742526 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:46.742492 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:46.911883 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:46.911840 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:48.944160 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:48.944126 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:51.995976 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:51.995889 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:52.159965 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:52.159933 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:54.016205 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:54.016176 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:55.029058 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:55.029020 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:23:58.052424 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:58.052385 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:58.116759 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:58.116726 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:58.275535 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:58.275503 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:58.374735 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:58.374699 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:59.475719 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:59.475670 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:59.600895 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:59.600860 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:59.710822 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:23:59.710788 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:00.155686 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:00.155634 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:00.257349 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:00.257320 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:00.357255 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:00.357222 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:01.588869 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:01.588833 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:03.802404 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:03.802375 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:03.986327 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:03.986295 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:04.074255 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:04.074173 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:04.190893 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:04.190863 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:06.173050 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:06.173014 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:09.994708 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:09.994674 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:10.084683 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:10.084639 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:10.494741 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:10.494711 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:10.592431 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:10.592399 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:10.691978 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:10.691941 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:12.126152 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:12.126107 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:18.093858 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:18.093823 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:18.206973 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:18.206943 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:18.351062 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:18.351033 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:18.483841 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:18.483795 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:18.815994 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:18.815900 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:44.798140 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:44.798108 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:50.626997 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:50.626962 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:50.764010 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:50.763964 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:24:50.960158 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:24:50.960071 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:06.776779 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:06.776737 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:12.658271 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:12.658222 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:12.768702 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:12.768665 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:12.868866 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:12.868773 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:23.402740 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:23.402704 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:24.701724 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:24.701686 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:29.990823 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:29.990788 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:30.093402 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:30.093360 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:30.191375 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:30.191344 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:30.291035 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:30.290932 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:31.052784 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:31.052753 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:31.194384 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:31.194352 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:31.294223 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:31.294190 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:32.330381 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:32.330350 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:25:32.878113 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:32.878083 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:38.604410 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:38.604377 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:38.709919 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:38.709887 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:39.299676 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:39.299626 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:41.027316 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:41.027276 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:25:44.925897 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:44.925867 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:45.026688 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:45.026638 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:45.170049 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:45.170017 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:45.494256 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:45.494222 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:45.952077 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:45.952041 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:48.363855 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:48.363817 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:48.461045 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:48.461005 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:48.528539 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:48.528501 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:48.717842 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:48.717755 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:48.917325 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:48.917276 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:49.021927 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:49.021845 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:50.927061 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:50.927024 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:25:52.776295 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:52.776257 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:53.420551 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:53.420508 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:53.519337 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:53.519308 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:54.080078 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:54.080040 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:59.645354 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:59.645318 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:59.746164 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:25:59.746131 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:00.112002 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:00.111969 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:00.451355 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:00.451246 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:00.552135 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:00.552103 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:04.429464 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:04.429437 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:26:06.514940 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:06.514902 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:06.577938 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:06.577897 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:06.810528 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:06.810423 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:07.072383 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:07.072294 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:07.179066 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:07.179034 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:07.279033 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:07.278992 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:07.423835 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:07.423789 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:13.326668 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:13.326613 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:13.435561 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:13.435527 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:13.526157 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:13.526120 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:13.682744 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:13.682707 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:19.419614 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:19.419578 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:19.519053 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:19.519024 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:26.271029 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:26.270991 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:26.595422 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:26.595335 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:26.811430 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:26.811394 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:29.598565 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:29.598530 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:29.703071 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:29.703024 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:29.785134 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:29.785099 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:30.278450 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:30.278405 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:30.376987 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:30.376942 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:30.510662 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:30.510623 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:34.045031 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:34.045004 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:34.861933 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:34.861900 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:26:39.838030 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:39.837991 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:39.937413 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:39.937379 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:43.481284 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:43.481212 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:44.773083 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:44.773036 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:44.878371 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:44.878337 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:46.930567 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:46.930534 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:26:52.526999 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:52.526965 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:26:52.613457 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:26:52.613416 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:04.001099 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:27:04.001060 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:04.531003 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:27:04.530969 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:27:06.793142 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:27:06.793107 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:07.207478 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:27:07.207415 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:12.939708 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:27:12.939670 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:17.965781 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:27:17.965739 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:18.536782 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:27:18.536746 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:27:20.493449 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:27:20.493410 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:54.580239 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:27:54.580204 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:55.437296 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:27:55.437270 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:57.934852 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:27:57.934817 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:28:01.134390 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:01.134359 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:01.232430 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:01.232380 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:01.414580 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:01.414463 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:01.644605 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:01.644574 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:02.742245 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:02.742210 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:02.877474 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:02.877427 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:03.008094 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:03.008007 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:03.739087 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:03.739055 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:04.044425 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:04.044325 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:04.144617 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:04.144584 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:05.367456 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:05.367423 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:07.540131 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:07.540098 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:28:11.464106 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:11.464067 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:11.565022 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:11.564989 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:12.165369 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:12.165334 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:18.335961 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:18.335848 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:18.450190 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:18.450153 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:18.535803 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:18.535769 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:18.735239 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:18.735206 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:28:21.359540 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:21.359511 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 14:28:21.363186 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:21.363166 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 14:28:29.073617 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:29.073578 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:29.420082 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:29.420047 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:50.423081 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:50.423049 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:56.305598 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:56.305515 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:56.372075 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:56.372041 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:56.667292 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:56.667255 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:57.074718 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:57.074588 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:57.177105 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:28:57.177067 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:00.389302 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:00.389261 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:00.469693 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:00.469640 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:00.543291 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:00.543254 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:00.711762 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:00.711669 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:01.101557 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:01.101528 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:01.197951 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:01.197918 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:04.912328 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:04.912283 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:05.255064 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:05.254973 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:05.596280 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:05.596191 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:05.892515 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:05.892472 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:08.236540 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:08.236507 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:29:08.438923 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:08.438884 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:08.534473 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:08.534378 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:08.723915 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:08.723882 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:09.031915 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:09.031881 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:09.367793 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:09.367765 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:09.468589 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:09.468561 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:13.018021 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:13.017984 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:19.252778 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:19.252737 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:29:23.280948 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:23.280903 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:23.379905 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:23.379867 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:23.842949 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:23.842918 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q"] Jul 09 14:29:23.846137 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:23.846115 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:23.850030 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:23.850010 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a8a58b\"/\"default-dockercfg-dxlck\"" Jul 09 14:29:23.850030 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:23.850025 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a8a58b\"/\"test-model-a8a58b-kserve-self-signed-certs\"" Jul 09 14:29:23.850305 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:23.850287 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a8a58b\"/\"openshift-service-ca.crt\"" Jul 09 14:29:23.850374 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:23.850358 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a8a58b\"/\"kube-root-ca.crt\"" Jul 09 14:29:23.862467 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:23.862446 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q"] Jul 09 14:29:23.895086 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:23.895052 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:23.927308 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:23.927277 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-dshm\") pod \"test-model-a8a58b-kserve-6d9c448c95-vp64q\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:23.927451 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:23.927324 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf9nc\" (UniqueName: \"kubernetes.io/projected/5370103d-44a2-478a-b3b6-fd94a63d6f2e-kube-api-access-xf9nc\") pod \"test-model-a8a58b-kserve-6d9c448c95-vp64q\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:23.927451 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:23.927414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-tmp-dir\") pod \"test-model-a8a58b-kserve-6d9c448c95-vp64q\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:23.927451 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:23.927442 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-model-cache\") pod \"test-model-a8a58b-kserve-6d9c448c95-vp64q\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:23.927599 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:23.927481 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-home\") pod \"test-model-a8a58b-kserve-6d9c448c95-vp64q\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:23.927599 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:23.927525 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5370103d-44a2-478a-b3b6-fd94a63d6f2e-tls-certs\") pod \"test-model-a8a58b-kserve-6d9c448c95-vp64q\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:24.028201 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:24.028160 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-tmp-dir\") pod \"test-model-a8a58b-kserve-6d9c448c95-vp64q\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:24.028201 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:24.028204 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-model-cache\") pod \"test-model-a8a58b-kserve-6d9c448c95-vp64q\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:24.028405 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:24.028252 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-home\") pod \"test-model-a8a58b-kserve-6d9c448c95-vp64q\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:24.028405 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:24.028286 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5370103d-44a2-478a-b3b6-fd94a63d6f2e-tls-certs\") pod \"test-model-a8a58b-kserve-6d9c448c95-vp64q\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:24.028405 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:24.028329 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-dshm\") pod \"test-model-a8a58b-kserve-6d9c448c95-vp64q\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:24.028405 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:24.028371 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf9nc\" (UniqueName: \"kubernetes.io/projected/5370103d-44a2-478a-b3b6-fd94a63d6f2e-kube-api-access-xf9nc\") pod \"test-model-a8a58b-kserve-6d9c448c95-vp64q\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:24.028638 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:24.028618 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-tmp-dir\") pod \"test-model-a8a58b-kserve-6d9c448c95-vp64q\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:24.028754 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:24.028712 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-home\") pod \"test-model-a8a58b-kserve-6d9c448c95-vp64q\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:24.028803 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:24.028790 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-model-cache\") pod \"test-model-a8a58b-kserve-6d9c448c95-vp64q\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:24.030575 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:24.030553 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-dshm\") pod \"test-model-a8a58b-kserve-6d9c448c95-vp64q\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:24.030871 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:24.030850 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5370103d-44a2-478a-b3b6-fd94a63d6f2e-tls-certs\") pod \"test-model-a8a58b-kserve-6d9c448c95-vp64q\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:24.038641 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:24.038618 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf9nc\" (UniqueName: \"kubernetes.io/projected/5370103d-44a2-478a-b3b6-fd94a63d6f2e-kube-api-access-xf9nc\") pod \"test-model-a8a58b-kserve-6d9c448c95-vp64q\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:24.155609 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:24.155569 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:24.291402 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:24.291374 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q"] Jul 09 14:29:24.293264 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:29:24.293235 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5370103d_44a2_478a_b3b6_fd94a63d6f2e.slice/crio-9a4b616b50391215aa8e1f2f18dc41472745f7eb24af8fcd913f4dca10f0e120 WatchSource:0}: Error finding container 9a4b616b50391215aa8e1f2f18dc41472745f7eb24af8fcd913f4dca10f0e120: Status 404 returned error can't find the container with id 9a4b616b50391215aa8e1f2f18dc41472745f7eb24af8fcd913f4dca10f0e120 Jul 09 14:29:24.829352 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:24.829320 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" event={"ID":"5370103d-44a2-478a-b3b6-fd94a63d6f2e","Type":"ContainerStarted","Data":"445c0c4d416027310e9236e13852fc2ff12444241c8167a69e9d04796dc1bd84"} Jul 09 14:29:24.829352 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:24.829357 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" event={"ID":"5370103d-44a2-478a-b3b6-fd94a63d6f2e","Type":"ContainerStarted","Data":"9a4b616b50391215aa8e1f2f18dc41472745f7eb24af8fcd913f4dca10f0e120"} Jul 09 14:29:24.875792 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:24.875737 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" podStartSLOduration=1.875720099 podStartE2EDuration="1.875720099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:29:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:29:24.875030555 +0000 UTC m=+1864.051717848" watchObservedRunningTime="2026-07-09 14:29:24.875720099 +0000 UTC m=+1864.052407451" Jul 09 14:29:27.930932 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:27.930897 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:29:30.270876 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:30.270840 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:30.373135 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:30.373092 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:34.155808 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:34.155768 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:34.156304 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:34.155826 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:34.168368 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:34.168335 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:34.884018 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:34.883990 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:29:41.869919 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:41.869877 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:29:47.397583 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:47.397494 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:54.341738 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:29:54.341703 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:30:11.984246 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:11.984206 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q"] Jul 09 14:30:12.012551 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:12.012471 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:12.908244 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:12.908209 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:12.980447 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:12.980414 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:13.138199 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:13.138147 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:13.566955 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:13.566924 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:13.665056 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:13.665016 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:13.842766 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:13.842683 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:18.293941 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:18.293908 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:30:18.633812 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:18.633765 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:27.004045 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.003984 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" podUID="5370103d-44a2-478a-b3b6-fd94a63d6f2e" containerName="main" containerID="cri-o://445c0c4d416027310e9236e13852fc2ff12444241c8167a69e9d04796dc1bd84" gracePeriod=45 Jul 09 14:30:27.137561 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.137532 2565 generic.go:356] "Generic (PLEG): container finished" podID="5370103d-44a2-478a-b3b6-fd94a63d6f2e" containerID="445c0c4d416027310e9236e13852fc2ff12444241c8167a69e9d04796dc1bd84" exitCode=0 Jul 09 14:30:27.137728 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.137600 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" event={"ID":"5370103d-44a2-478a-b3b6-fd94a63d6f2e","Type":"ContainerDied","Data":"445c0c4d416027310e9236e13852fc2ff12444241c8167a69e9d04796dc1bd84"} Jul 09 14:30:27.267594 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.267540 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:30:27.410483 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.410453 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5370103d-44a2-478a-b3b6-fd94a63d6f2e-tls-certs\") pod \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " Jul 09 14:30:27.410687 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.410492 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-tmp-dir\") pod \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " Jul 09 14:30:27.410687 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.410515 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-model-cache\") pod \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " Jul 09 14:30:27.410687 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.410532 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-home\") pod \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " Jul 09 14:30:27.410687 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.410587 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf9nc\" (UniqueName: \"kubernetes.io/projected/5370103d-44a2-478a-b3b6-fd94a63d6f2e-kube-api-access-xf9nc\") pod \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " Jul 09 14:30:27.410687 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.410612 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-dshm\") pod \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\" (UID: \"5370103d-44a2-478a-b3b6-fd94a63d6f2e\") " Jul 09 14:30:27.410975 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.410804 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5370103d-44a2-478a-b3b6-fd94a63d6f2e" (UID: "5370103d-44a2-478a-b3b6-fd94a63d6f2e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:30:27.410975 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.410847 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-model-cache" (OuterVolumeSpecName: "model-cache") pod "5370103d-44a2-478a-b3b6-fd94a63d6f2e" (UID: "5370103d-44a2-478a-b3b6-fd94a63d6f2e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:30:27.410975 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.410885 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-home" (OuterVolumeSpecName: "home") pod "5370103d-44a2-478a-b3b6-fd94a63d6f2e" (UID: "5370103d-44a2-478a-b3b6-fd94a63d6f2e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:30:27.410975 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.410962 2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-tmp-dir\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:30:27.411131 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.410981 2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-model-cache\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:30:27.411131 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.410994 2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-home\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:30:27.412878 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.412856 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5370103d-44a2-478a-b3b6-fd94a63d6f2e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5370103d-44a2-478a-b3b6-fd94a63d6f2e" (UID: "5370103d-44a2-478a-b3b6-fd94a63d6f2e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:30:27.412955 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.412872 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5370103d-44a2-478a-b3b6-fd94a63d6f2e-kube-api-access-xf9nc" (OuterVolumeSpecName: "kube-api-access-xf9nc") pod "5370103d-44a2-478a-b3b6-fd94a63d6f2e" (UID: "5370103d-44a2-478a-b3b6-fd94a63d6f2e"). InnerVolumeSpecName "kube-api-access-xf9nc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:30:27.412955 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.412940 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-dshm" (OuterVolumeSpecName: "dshm") pod "5370103d-44a2-478a-b3b6-fd94a63d6f2e" (UID: "5370103d-44a2-478a-b3b6-fd94a63d6f2e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:30:27.511903 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.511872 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5370103d-44a2-478a-b3b6-fd94a63d6f2e-tls-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:30:27.511903 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.511898 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf9nc\" (UniqueName: \"kubernetes.io/projected/5370103d-44a2-478a-b3b6-fd94a63d6f2e-kube-api-access-xf9nc\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:30:27.511903 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:27.511906 2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5370103d-44a2-478a-b3b6-fd94a63d6f2e-dshm\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:30:28.143365 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:28.143336 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" Jul 09 14:30:28.143830 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:28.143363 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q" event={"ID":"5370103d-44a2-478a-b3b6-fd94a63d6f2e","Type":"ContainerDied","Data":"9a4b616b50391215aa8e1f2f18dc41472745f7eb24af8fcd913f4dca10f0e120"} Jul 09 14:30:28.143830 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:28.143409 2565 scope.go:117] "RemoveContainer" containerID="445c0c4d416027310e9236e13852fc2ff12444241c8167a69e9d04796dc1bd84" Jul 09 14:30:28.168319 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:28.168282 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q"] Jul 09 14:30:28.173475 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:28.170601 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-a8a58b/test-model-a8a58b-kserve-6d9c448c95-vp64q"] Jul 09 14:30:29.351207 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:29.351171 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5370103d-44a2-478a-b3b6-fd94a63d6f2e" path="/var/lib/kubelet/pods/5370103d-44a2-478a-b3b6-fd94a63d6f2e/volumes" Jul 09 14:30:55.585731 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:55.585697 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:57.333624 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:57.333586 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:59.941843 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:30:59.941806 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:31:02.861258 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:02.861223 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:02.962162 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:02.962127 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:03.124937 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:03.124834 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:03.369666 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:03.369619 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:03.735384 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:03.735350 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:04.107670 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:04.107619 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:04.199926 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:04.199888 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:07.205484 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:07.205432 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:07.430407 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:07.430371 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:07.585721 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:07.585600 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:07.752033 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:07.751998 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:07.997484 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:07.997433 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:08.097491 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:08.097460 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:11.658971 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:11.658936 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:12.168238 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:12.168210 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:12.531051 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:12.530960 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:12.697609 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:12.697578 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:15.244090 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:15.244006 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:31:15.347019 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:15.346986 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:15.550296 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:15.550212 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:15.664580 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:15.664549 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:15.804542 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:15.804456 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:16.105388 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:16.105359 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:16.207256 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:16.207222 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:19.735472 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:19.735440 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:27.914142 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:27.914101 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:28.292817 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:28.292724 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:28.658540 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:28.658508 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:28.754759 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:28.754732 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:29.003446 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:29.003358 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:30.456704 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:30.456670 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:31:34.412255 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:34.412209 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:34.516940 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:34.516899 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:35.028192 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:35.028155 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:35.127794 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:35.127757 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:35.529836 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:35.529797 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:35.630352 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:35.630321 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:35.732015 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:35.731980 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:35.937079 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:35.937048 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:40.651766 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:40.651730 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:31:41.663541 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:41.663507 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:41.759738 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:41.759705 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:42.056742 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:42.056637 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:42.228527 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:42.228484 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:42.544525 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:42.544492 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:42.919370 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:42.919334 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:43.142143 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:43.142107 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:45.434687 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:45.434642 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:45.581847 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:45.581817 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:46.037166 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:46.037132 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:46.148484 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:46.148440 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:46.328911 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:46.328822 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:46.617466 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:46.617429 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:47.108930 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:47.108898 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:47.290776 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:47.290739 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:49.872855 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:49.872816 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:50.248118 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:50.248020 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:50.760967 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:50.760930 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:50.861400 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:50.861362 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:53.332421 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:53.332383 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:31:53.435097 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:53.435054 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:53.545105 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:53.545073 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:53.640963 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:53.640927 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:53.744010 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:53.743975 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:54.129013 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:54.128965 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:54.280048 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:54.280000 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:31:58.025709 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:31:58.025672 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:04.536790 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:04.536756 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:32:05.841594 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:05.841552 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw"] Jul 09 14:32:05.842061 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:05.841938 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5370103d-44a2-478a-b3b6-fd94a63d6f2e" containerName="main" Jul 09 14:32:05.842061 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:05.841950 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5370103d-44a2-478a-b3b6-fd94a63d6f2e" containerName="main" Jul 09 14:32:05.842061 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:05.842017 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5370103d-44a2-478a-b3b6-fd94a63d6f2e" containerName="main" Jul 09 14:32:05.844944 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:05.844928 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:05.848926 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:05.848898 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5a8685\"/\"auth-test-model-5a8685-kserve-self-signed-certs\"" Jul 09 14:32:05.848926 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:05.848909 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5a8685\"/\"openshift-service-ca.crt\"" Jul 09 14:32:05.849175 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:05.848938 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5a8685\"/\"default-dockercfg-vj4tv\"" Jul 09 14:32:05.849175 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:05.848909 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5a8685\"/\"kube-root-ca.crt\"" Jul 09 14:32:05.856234 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:05.856213 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw"] Jul 09 14:32:05.915547 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:05.915513 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:05.988367 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:05.988322 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-dshm\") pod \"auth-test-model-5a8685-kserve-748bc49555-qlclw\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:05.988367 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:05.988362 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxb6k\" (UniqueName: \"kubernetes.io/projected/e0a93739-578d-4928-b373-f00c4ad98935-kube-api-access-sxb6k\") pod \"auth-test-model-5a8685-kserve-748bc49555-qlclw\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:05.988627 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:05.988394 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-home\") pod \"auth-test-model-5a8685-kserve-748bc49555-qlclw\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:05.988627 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:05.988417 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0a93739-578d-4928-b373-f00c4ad98935-tls-certs\") pod \"auth-test-model-5a8685-kserve-748bc49555-qlclw\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:05.988627 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:05.988465 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-model-cache\") pod \"auth-test-model-5a8685-kserve-748bc49555-qlclw\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:05.988627 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:05.988511 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-tmp-dir\") pod \"auth-test-model-5a8685-kserve-748bc49555-qlclw\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:06.088921 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:06.088891 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-model-cache\") pod \"auth-test-model-5a8685-kserve-748bc49555-qlclw\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:06.089089 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:06.088933 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-tmp-dir\") pod \"auth-test-model-5a8685-kserve-748bc49555-qlclw\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:06.089089 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:06.088961 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-dshm\") pod \"auth-test-model-5a8685-kserve-748bc49555-qlclw\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:06.089089 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:06.088990 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxb6k\" (UniqueName: \"kubernetes.io/projected/e0a93739-578d-4928-b373-f00c4ad98935-kube-api-access-sxb6k\") pod \"auth-test-model-5a8685-kserve-748bc49555-qlclw\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:06.089089 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:06.089021 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-home\") pod \"auth-test-model-5a8685-kserve-748bc49555-qlclw\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:06.089089 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:06.089045 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0a93739-578d-4928-b373-f00c4ad98935-tls-certs\") pod \"auth-test-model-5a8685-kserve-748bc49555-qlclw\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:06.089393 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:06.089360 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-tmp-dir\") pod \"auth-test-model-5a8685-kserve-748bc49555-qlclw\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:06.089393 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:06.089387 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-model-cache\") pod \"auth-test-model-5a8685-kserve-748bc49555-qlclw\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:06.089582 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:06.089552 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-home\") pod \"auth-test-model-5a8685-kserve-748bc49555-qlclw\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:06.091513 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:06.091489 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-dshm\") pod \"auth-test-model-5a8685-kserve-748bc49555-qlclw\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:06.091710 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:06.091639 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0a93739-578d-4928-b373-f00c4ad98935-tls-certs\") pod \"auth-test-model-5a8685-kserve-748bc49555-qlclw\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:06.103827 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:06.103798 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxb6k\" (UniqueName: \"kubernetes.io/projected/e0a93739-578d-4928-b373-f00c4ad98935-kube-api-access-sxb6k\") pod \"auth-test-model-5a8685-kserve-748bc49555-qlclw\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:06.153850 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:06.153816 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:06.293272 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:06.293245 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw"] Jul 09 14:32:06.295887 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:32:06.295860 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0a93739_578d_4928_b373_f00c4ad98935.slice/crio-5cc052370562ba33cf1ea651fd1d320bc1057cfb0723cd60901eabd9d092d458 WatchSource:0}: Error finding container 5cc052370562ba33cf1ea651fd1d320bc1057cfb0723cd60901eabd9d092d458: Status 404 returned error can't find the container with id 5cc052370562ba33cf1ea651fd1d320bc1057cfb0723cd60901eabd9d092d458 Jul 09 14:32:06.604395 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:06.604362 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" event={"ID":"e0a93739-578d-4928-b373-f00c4ad98935","Type":"ContainerStarted","Data":"173d181c81559466267ad162bcd9be347c6a9f603c4a6b53b556ec2a4fe5ac48"} Jul 09 14:32:06.604595 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:06.604413 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" event={"ID":"e0a93739-578d-4928-b373-f00c4ad98935","Type":"ContainerStarted","Data":"5cc052370562ba33cf1ea651fd1d320bc1057cfb0723cd60901eabd9d092d458"} Jul 09 14:32:06.622258 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:06.622202 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" podStartSLOduration=1.622186133 podStartE2EDuration="1.622186133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:32:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:06.620156017 +0000 UTC m=+2025.796843309" watchObservedRunningTime="2026-07-09 14:32:06.622186133 +0000 UTC m=+2025.798873425" Jul 09 14:32:08.005256 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:08.005214 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:08.101667 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:08.101600 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:15.009211 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:15.009180 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:15.110533 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:15.110495 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:16.154317 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:16.154278 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:16.154317 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:16.154325 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:16.167051 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:16.167025 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:16.664724 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:16.664697 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:32:17.250351 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:17.250314 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:32:32.472924 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:32.472891 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:36.534516 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:36.534478 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:32:50.542065 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:32:50.541974 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:33:10.433996 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:33:10.433959 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:33:21.387544 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:33:21.387513 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 14:33:21.391079 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:33:21.391060 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 14:33:24.940006 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:33:24.939964 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:33:26.092283 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:33:26.092248 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:41.025933 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:33:41.025889 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:33:59.934157 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:33:59.934119 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:34:12.160363 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:12.160327 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:18.638979 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:18.638900 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:34:31.838631 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:31.838597 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:32.395958 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:32.395927 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw"] Jul 09 14:34:32.410336 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:32.410308 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:33.393459 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:33.393426 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:37.634863 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.634824 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:34:37.636758 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.636731 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx"] Jul 09 14:34:37.640160 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.640139 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.642990 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.642973 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5a8685\"/\"sub-test-model-5a8685-kserve-self-signed-certs\"" Jul 09 14:34:37.646335 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.646310 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx"] Jul 09 14:34:37.664470 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.664433 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhpwm\" (UniqueName: \"kubernetes.io/projected/4c28995d-b6af-40b7-a4ff-0d6538e50280-kube-api-access-jhpwm\") pod \"sub-test-model-5a8685-kserve-647f75f545-tfvfx\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.664470 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.664473 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-dshm\") pod \"sub-test-model-5a8685-kserve-647f75f545-tfvfx\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.664690 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.664506 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-home\") pod \"sub-test-model-5a8685-kserve-647f75f545-tfvfx\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.664690 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.664528 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-model-cache\") pod \"sub-test-model-5a8685-kserve-647f75f545-tfvfx\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.664690 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.664597 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c28995d-b6af-40b7-a4ff-0d6538e50280-tls-certs\") pod \"sub-test-model-5a8685-kserve-647f75f545-tfvfx\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.664860 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.664701 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-tmp-dir\") pod \"sub-test-model-5a8685-kserve-647f75f545-tfvfx\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.765396 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.765364 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhpwm\" (UniqueName: \"kubernetes.io/projected/4c28995d-b6af-40b7-a4ff-0d6538e50280-kube-api-access-jhpwm\") pod \"sub-test-model-5a8685-kserve-647f75f545-tfvfx\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.765610 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.765407 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-dshm\") pod \"sub-test-model-5a8685-kserve-647f75f545-tfvfx\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.765610 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.765440 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-home\") pod \"sub-test-model-5a8685-kserve-647f75f545-tfvfx\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.765610 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.765455 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-model-cache\") pod \"sub-test-model-5a8685-kserve-647f75f545-tfvfx\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.765610 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.765480 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c28995d-b6af-40b7-a4ff-0d6538e50280-tls-certs\") pod \"sub-test-model-5a8685-kserve-647f75f545-tfvfx\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.765610 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.765517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-tmp-dir\") pod \"sub-test-model-5a8685-kserve-647f75f545-tfvfx\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.765978 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.765953 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-model-cache\") pod \"sub-test-model-5a8685-kserve-647f75f545-tfvfx\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.766092 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.765995 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-tmp-dir\") pod \"sub-test-model-5a8685-kserve-647f75f545-tfvfx\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.766092 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.766056 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-home\") pod \"sub-test-model-5a8685-kserve-647f75f545-tfvfx\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.767714 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.767695 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-dshm\") pod \"sub-test-model-5a8685-kserve-647f75f545-tfvfx\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.768091 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.768070 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c28995d-b6af-40b7-a4ff-0d6538e50280-tls-certs\") pod \"sub-test-model-5a8685-kserve-647f75f545-tfvfx\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.775181 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.775154 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhpwm\" (UniqueName: \"kubernetes.io/projected/4c28995d-b6af-40b7-a4ff-0d6538e50280-kube-api-access-jhpwm\") pod \"sub-test-model-5a8685-kserve-647f75f545-tfvfx\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:37.831533 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.831480 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:37.950177 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:37.950079 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:38.103153 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:38.103118 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx"] Jul 09 14:34:38.106774 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:34:38.106751 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c28995d_b6af_40b7_a4ff_0d6538e50280.slice/crio-9a4839b6f531e69a78e3a79b16ba09a4714d837ded1a21edf7709fefbae4a990 WatchSource:0}: Error finding container 9a4839b6f531e69a78e3a79b16ba09a4714d837ded1a21edf7709fefbae4a990: Status 404 returned error can't find the container with id 9a4839b6f531e69a78e3a79b16ba09a4714d837ded1a21edf7709fefbae4a990 Jul 09 14:34:38.330257 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:38.330167 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" event={"ID":"4c28995d-b6af-40b7-a4ff-0d6538e50280","Type":"ContainerStarted","Data":"7ffcafdd3221654aac84c03a657a8b7f60a0b7c9b593a7eb09ba71827ac4e8fa"} Jul 09 14:34:38.330257 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:38.330207 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" event={"ID":"4c28995d-b6af-40b7-a4ff-0d6538e50280","Type":"ContainerStarted","Data":"9a4839b6f531e69a78e3a79b16ba09a4714d837ded1a21edf7709fefbae4a990"} Jul 09 14:34:38.350330 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:38.350283 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" podStartSLOduration=1.350268405 podStartE2EDuration="1.350268405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:34:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:34:38.348850676 +0000 UTC m=+2177.525537967" watchObservedRunningTime="2026-07-09 14:34:38.350268405 +0000 UTC m=+2177.526955697" Jul 09 14:34:47.416575 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.416532 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" podUID="e0a93739-578d-4928-b373-f00c4ad98935" containerName="main" containerID="cri-o://173d181c81559466267ad162bcd9be347c6a9f603c4a6b53b556ec2a4fe5ac48" gracePeriod=45 Jul 09 14:34:47.675475 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.675410 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:34:47.751449 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.751415 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0a93739-578d-4928-b373-f00c4ad98935-tls-certs\") pod \"e0a93739-578d-4928-b373-f00c4ad98935\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " Jul 09 14:34:47.751449 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.751455 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-dshm\") pod \"e0a93739-578d-4928-b373-f00c4ad98935\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " Jul 09 14:34:47.751756 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.751511 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-tmp-dir\") pod \"e0a93739-578d-4928-b373-f00c4ad98935\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " Jul 09 14:34:47.751756 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.751531 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-model-cache\") pod \"e0a93739-578d-4928-b373-f00c4ad98935\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " Jul 09 14:34:47.751756 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.751559 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxb6k\" (UniqueName: \"kubernetes.io/projected/e0a93739-578d-4928-b373-f00c4ad98935-kube-api-access-sxb6k\") pod \"e0a93739-578d-4928-b373-f00c4ad98935\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " Jul 09 14:34:47.751756 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.751602 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-home\") pod \"e0a93739-578d-4928-b373-f00c4ad98935\" (UID: \"e0a93739-578d-4928-b373-f00c4ad98935\") " Jul 09 14:34:47.751970 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.751832 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e0a93739-578d-4928-b373-f00c4ad98935" (UID: "e0a93739-578d-4928-b373-f00c4ad98935"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:34:47.751970 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.751851 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-model-cache" (OuterVolumeSpecName: "model-cache") pod "e0a93739-578d-4928-b373-f00c4ad98935" (UID: "e0a93739-578d-4928-b373-f00c4ad98935"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:34:47.751970 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.751956 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-home" (OuterVolumeSpecName: "home") pod "e0a93739-578d-4928-b373-f00c4ad98935" (UID: "e0a93739-578d-4928-b373-f00c4ad98935"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:34:47.752124 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.752012 2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-tmp-dir\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:34:47.752124 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.752031 2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-model-cache\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:34:47.753936 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.753909 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-dshm" (OuterVolumeSpecName: "dshm") pod "e0a93739-578d-4928-b373-f00c4ad98935" (UID: "e0a93739-578d-4928-b373-f00c4ad98935"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:34:47.754022 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.753929 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0a93739-578d-4928-b373-f00c4ad98935-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e0a93739-578d-4928-b373-f00c4ad98935" (UID: "e0a93739-578d-4928-b373-f00c4ad98935"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:34:47.754022 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.754007 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0a93739-578d-4928-b373-f00c4ad98935-kube-api-access-sxb6k" (OuterVolumeSpecName: "kube-api-access-sxb6k") pod "e0a93739-578d-4928-b373-f00c4ad98935" (UID: "e0a93739-578d-4928-b373-f00c4ad98935"). InnerVolumeSpecName "kube-api-access-sxb6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:34:47.853055 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.853015 2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-home\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:34:47.853055 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.853048 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0a93739-578d-4928-b373-f00c4ad98935-tls-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:34:47.853055 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.853058 2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0a93739-578d-4928-b373-f00c4ad98935-dshm\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:34:47.853299 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.853068 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxb6k\" (UniqueName: \"kubernetes.io/projected/e0a93739-578d-4928-b373-f00c4ad98935-kube-api-access-sxb6k\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:34:47.951087 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.950991 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:47.951087 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.951052 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:47.963724 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:47.963693 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:48.383415 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:48.383376 2565 generic.go:356] "Generic (PLEG): container finished" podID="e0a93739-578d-4928-b373-f00c4ad98935" containerID="173d181c81559466267ad162bcd9be347c6a9f603c4a6b53b556ec2a4fe5ac48" exitCode=0 Jul 09 14:34:48.383586 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:48.383424 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" Jul 09 14:34:48.383586 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:48.383463 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" event={"ID":"e0a93739-578d-4928-b373-f00c4ad98935","Type":"ContainerDied","Data":"173d181c81559466267ad162bcd9be347c6a9f603c4a6b53b556ec2a4fe5ac48"} Jul 09 14:34:48.383586 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:48.383506 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw" event={"ID":"e0a93739-578d-4928-b373-f00c4ad98935","Type":"ContainerDied","Data":"5cc052370562ba33cf1ea651fd1d320bc1057cfb0723cd60901eabd9d092d458"} Jul 09 14:34:48.383586 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:48.383525 2565 scope.go:117] "RemoveContainer" containerID="173d181c81559466267ad162bcd9be347c6a9f603c4a6b53b556ec2a4fe5ac48" Jul 09 14:34:48.393497 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:48.393478 2565 scope.go:117] "RemoveContainer" containerID="173d181c81559466267ad162bcd9be347c6a9f603c4a6b53b556ec2a4fe5ac48" Jul 09 14:34:48.393788 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:34:48.393769 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"173d181c81559466267ad162bcd9be347c6a9f603c4a6b53b556ec2a4fe5ac48\": container with ID starting with 173d181c81559466267ad162bcd9be347c6a9f603c4a6b53b556ec2a4fe5ac48 not found: ID does not exist" containerID="173d181c81559466267ad162bcd9be347c6a9f603c4a6b53b556ec2a4fe5ac48" Jul 09 14:34:48.393861 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:48.393799 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"173d181c81559466267ad162bcd9be347c6a9f603c4a6b53b556ec2a4fe5ac48"} err="failed to get container status \"173d181c81559466267ad162bcd9be347c6a9f603c4a6b53b556ec2a4fe5ac48\": rpc error: code = NotFound desc = could not find container \"173d181c81559466267ad162bcd9be347c6a9f603c4a6b53b556ec2a4fe5ac48\": container with ID starting with 173d181c81559466267ad162bcd9be347c6a9f603c4a6b53b556ec2a4fe5ac48 not found: ID does not exist" Jul 09 14:34:48.397405 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:48.397385 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:34:48.406027 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:48.406003 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw"] Jul 09 14:34:48.409822 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:48.409799 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-5a8685/auth-test-model-5a8685-kserve-748bc49555-qlclw"] Jul 09 14:34:49.351632 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:49.351598 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0a93739-578d-4928-b373-f00c4ad98935" path="/var/lib/kubelet/pods/e0a93739-578d-4928-b373-f00c4ad98935/volumes" Jul 09 14:34:53.828998 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:34:53.828961 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:35:02.337747 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.337713 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp"] Jul 09 14:35:02.338114 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.338075 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a93739-578d-4928-b373-f00c4ad98935" containerName="main" Jul 09 14:35:02.338114 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.338085 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a93739-578d-4928-b373-f00c4ad98935" containerName="main" Jul 09 14:35:02.338183 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.338140 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0a93739-578d-4928-b373-f00c4ad98935" containerName="main" Jul 09 14:35:02.340839 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.340817 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.344834 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.344811 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a4b0c9\"/\"default-dockercfg-cg567\"" Jul 09 14:35:02.345048 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.344823 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a4b0c9\"/\"sub-test-model-a4b0c9-kserve-self-signed-certs\"" Jul 09 14:35:02.345048 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.344833 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a4b0c9\"/\"openshift-service-ca.crt\"" Jul 09 14:35:02.345248 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.344832 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a4b0c9\"/\"kube-root-ca.crt\"" Jul 09 14:35:02.352868 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.352846 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp"] Jul 09 14:35:02.374017 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.373986 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:02.480361 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.480328 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-home\") pod \"sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.480620 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.480375 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-dshm\") pod \"sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.480620 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.480409 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r8j5\" (UniqueName: \"kubernetes.io/projected/64334cb8-42af-401b-a93f-86ae3a36aa99-kube-api-access-5r8j5\") pod \"sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.480620 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.480472 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-tmp-dir\") pod \"sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.480620 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.480523 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64334cb8-42af-401b-a93f-86ae3a36aa99-tls-certs\") pod \"sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.480620 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.480547 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-model-cache\") pod \"sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.581627 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.581589 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-home\") pod \"sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.581940 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.581673 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-dshm\") pod \"sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.581940 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.581710 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r8j5\" (UniqueName: \"kubernetes.io/projected/64334cb8-42af-401b-a93f-86ae3a36aa99-kube-api-access-5r8j5\") pod \"sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.581940 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.581745 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-tmp-dir\") pod \"sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.581940 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.581792 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64334cb8-42af-401b-a93f-86ae3a36aa99-tls-certs\") pod \"sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.581940 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.581819 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-model-cache\") pod \"sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.583007 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.582080 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-home\") pod \"sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.583007 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.582173 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-tmp-dir\") pod \"sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.583007 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.582233 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-model-cache\") pod \"sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.584300 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.584276 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-dshm\") pod \"sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.584640 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.584623 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64334cb8-42af-401b-a93f-86ae3a36aa99-tls-certs\") pod \"sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.591915 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.591859 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r8j5\" (UniqueName: \"kubernetes.io/projected/64334cb8-42af-401b-a93f-86ae3a36aa99-kube-api-access-5r8j5\") pod \"sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.650551 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.650510 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:02.785016 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:02.784991 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp"] Jul 09 14:35:02.787741 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:35:02.787714 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64334cb8_42af_401b_a93f_86ae3a36aa99.slice/crio-6d84d3d4adc4b9c64fa69dd4f671dd3121d3d2f4351eddf2343e6343ee4b27b6 WatchSource:0}: Error finding container 6d84d3d4adc4b9c64fa69dd4f671dd3121d3d2f4351eddf2343e6343ee4b27b6: Status 404 returned error can't find the container with id 6d84d3d4adc4b9c64fa69dd4f671dd3121d3d2f4351eddf2343e6343ee4b27b6 Jul 09 14:35:03.459876 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:03.459838 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" event={"ID":"64334cb8-42af-401b-a93f-86ae3a36aa99","Type":"ContainerStarted","Data":"3e51a70c48ce8c9e4b0c44f05ad813a65fd1db8292674a1b326d9dadc9a1e376"} Jul 09 14:35:03.459876 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:03.459882 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" event={"ID":"64334cb8-42af-401b-a93f-86ae3a36aa99","Type":"ContainerStarted","Data":"6d84d3d4adc4b9c64fa69dd4f671dd3121d3d2f4351eddf2343e6343ee4b27b6"} Jul 09 14:35:03.482448 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:03.482395 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" podStartSLOduration=1.482381149 podStartE2EDuration="1.482381149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:35:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:35:03.480819529 +0000 UTC m=+2202.657506821" watchObservedRunningTime="2026-07-09 14:35:03.482381149 +0000 UTC m=+2202.659068441" Jul 09 14:35:09.633915 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:09.633877 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:35:12.651488 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:12.651449 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:12.651936 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:12.651518 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:12.664185 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:12.664158 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:13.517502 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:13.517459 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:35:26.833608 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:26.833573 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:35:44.118479 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:44.118383 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx"] Jul 09 14:35:44.145168 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:44.145129 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:45.222922 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:45.222885 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp"] Jul 09 14:35:45.237583 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:45.237534 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:47.531246 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:47.531209 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:35:55.673246 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:55.673211 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:59.138755 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.138710 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" podUID="4c28995d-b6af-40b7-a4ff-0d6538e50280" containerName="main" containerID="cri-o://7ffcafdd3221654aac84c03a657a8b7f60a0b7c9b593a7eb09ba71827ac4e8fa" gracePeriod=45 Jul 09 14:35:59.394051 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.393991 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:35:59.499577 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.499542 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-model-cache\") pod \"4c28995d-b6af-40b7-a4ff-0d6538e50280\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " Jul 09 14:35:59.499803 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.499619 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-tmp-dir\") pod \"4c28995d-b6af-40b7-a4ff-0d6538e50280\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " Jul 09 14:35:59.499803 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.499690 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-home\") pod \"4c28995d-b6af-40b7-a4ff-0d6538e50280\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " Jul 09 14:35:59.499803 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.499758 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c28995d-b6af-40b7-a4ff-0d6538e50280-tls-certs\") pod \"4c28995d-b6af-40b7-a4ff-0d6538e50280\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " Jul 09 14:35:59.499803 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.499784 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhpwm\" (UniqueName: \"kubernetes.io/projected/4c28995d-b6af-40b7-a4ff-0d6538e50280-kube-api-access-jhpwm\") pod \"4c28995d-b6af-40b7-a4ff-0d6538e50280\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " Jul 09 14:35:59.500012 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.499812 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-dshm\") pod \"4c28995d-b6af-40b7-a4ff-0d6538e50280\" (UID: \"4c28995d-b6af-40b7-a4ff-0d6538e50280\") " Jul 09 14:35:59.500012 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.499817 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-model-cache" (OuterVolumeSpecName: "model-cache") pod "4c28995d-b6af-40b7-a4ff-0d6538e50280" (UID: "4c28995d-b6af-40b7-a4ff-0d6538e50280"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:35:59.500012 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.499890 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4c28995d-b6af-40b7-a4ff-0d6538e50280" (UID: "4c28995d-b6af-40b7-a4ff-0d6538e50280"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:35:59.500012 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.499929 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-home" (OuterVolumeSpecName: "home") pod "4c28995d-b6af-40b7-a4ff-0d6538e50280" (UID: "4c28995d-b6af-40b7-a4ff-0d6538e50280"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:35:59.500144 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.500057 2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-tmp-dir\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:35:59.500144 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.500069 2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-home\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:35:59.500144 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.500078 2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-model-cache\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:35:59.501910 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.501873 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c28995d-b6af-40b7-a4ff-0d6538e50280-kube-api-access-jhpwm" (OuterVolumeSpecName: "kube-api-access-jhpwm") pod "4c28995d-b6af-40b7-a4ff-0d6538e50280" (UID: "4c28995d-b6af-40b7-a4ff-0d6538e50280"). InnerVolumeSpecName "kube-api-access-jhpwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:35:59.502186 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.502154 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c28995d-b6af-40b7-a4ff-0d6538e50280-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4c28995d-b6af-40b7-a4ff-0d6538e50280" (UID: "4c28995d-b6af-40b7-a4ff-0d6538e50280"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:35:59.502186 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.502168 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-dshm" (OuterVolumeSpecName: "dshm") pod "4c28995d-b6af-40b7-a4ff-0d6538e50280" (UID: "4c28995d-b6af-40b7-a4ff-0d6538e50280"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:35:59.601176 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.601144 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c28995d-b6af-40b7-a4ff-0d6538e50280-tls-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:35:59.601176 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.601173 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhpwm\" (UniqueName: \"kubernetes.io/projected/4c28995d-b6af-40b7-a4ff-0d6538e50280-kube-api-access-jhpwm\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:35:59.601176 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.601183 2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c28995d-b6af-40b7-a4ff-0d6538e50280-dshm\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:35:59.730315 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.730216 2565 generic.go:356] "Generic (PLEG): container finished" podID="4c28995d-b6af-40b7-a4ff-0d6538e50280" containerID="7ffcafdd3221654aac84c03a657a8b7f60a0b7c9b593a7eb09ba71827ac4e8fa" exitCode=0 Jul 09 14:35:59.730315 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.730267 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" event={"ID":"4c28995d-b6af-40b7-a4ff-0d6538e50280","Type":"ContainerDied","Data":"7ffcafdd3221654aac84c03a657a8b7f60a0b7c9b593a7eb09ba71827ac4e8fa"} Jul 09 14:35:59.730315 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.730271 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" Jul 09 14:35:59.730315 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.730306 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx" event={"ID":"4c28995d-b6af-40b7-a4ff-0d6538e50280","Type":"ContainerDied","Data":"9a4839b6f531e69a78e3a79b16ba09a4714d837ded1a21edf7709fefbae4a990"} Jul 09 14:35:59.730607 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.730327 2565 scope.go:117] "RemoveContainer" containerID="7ffcafdd3221654aac84c03a657a8b7f60a0b7c9b593a7eb09ba71827ac4e8fa" Jul 09 14:35:59.739556 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.739531 2565 scope.go:117] "RemoveContainer" containerID="7ffcafdd3221654aac84c03a657a8b7f60a0b7c9b593a7eb09ba71827ac4e8fa" Jul 09 14:35:59.739931 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:35:59.739910 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ffcafdd3221654aac84c03a657a8b7f60a0b7c9b593a7eb09ba71827ac4e8fa\": container with ID starting with 7ffcafdd3221654aac84c03a657a8b7f60a0b7c9b593a7eb09ba71827ac4e8fa not found: ID does not exist" containerID="7ffcafdd3221654aac84c03a657a8b7f60a0b7c9b593a7eb09ba71827ac4e8fa" Jul 09 14:35:59.740022 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.739949 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ffcafdd3221654aac84c03a657a8b7f60a0b7c9b593a7eb09ba71827ac4e8fa"} err="failed to get container status \"7ffcafdd3221654aac84c03a657a8b7f60a0b7c9b593a7eb09ba71827ac4e8fa\": rpc error: code = NotFound desc = could not find container \"7ffcafdd3221654aac84c03a657a8b7f60a0b7c9b593a7eb09ba71827ac4e8fa\": container with ID starting with 7ffcafdd3221654aac84c03a657a8b7f60a0b7c9b593a7eb09ba71827ac4e8fa not found: ID does not exist" Jul 09 14:35:59.750913 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.750888 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx"] Jul 09 14:35:59.757514 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:35:59.757489 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-5a8685/sub-test-model-5a8685-kserve-647f75f545-tfvfx"] Jul 09 14:36:00.243213 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.243163 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" podUID="64334cb8-42af-401b-a93f-86ae3a36aa99" containerName="main" containerID="cri-o://3e51a70c48ce8c9e4b0c44f05ad813a65fd1db8292674a1b326d9dadc9a1e376" gracePeriod=45 Jul 09 14:36:00.495801 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.495744 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:36:00.610465 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.610431 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-dshm\") pod \"64334cb8-42af-401b-a93f-86ae3a36aa99\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " Jul 09 14:36:00.610634 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.610535 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-tmp-dir\") pod \"64334cb8-42af-401b-a93f-86ae3a36aa99\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " Jul 09 14:36:00.610634 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.610561 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-model-cache\") pod \"64334cb8-42af-401b-a93f-86ae3a36aa99\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " Jul 09 14:36:00.610634 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.610596 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-home\") pod \"64334cb8-42af-401b-a93f-86ae3a36aa99\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " Jul 09 14:36:00.610634 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.610626 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5r8j5\" (UniqueName: \"kubernetes.io/projected/64334cb8-42af-401b-a93f-86ae3a36aa99-kube-api-access-5r8j5\") pod \"64334cb8-42af-401b-a93f-86ae3a36aa99\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " Jul 09 14:36:00.610880 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.610676 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64334cb8-42af-401b-a93f-86ae3a36aa99-tls-certs\") pod \"64334cb8-42af-401b-a93f-86ae3a36aa99\" (UID: \"64334cb8-42af-401b-a93f-86ae3a36aa99\") " Jul 09 14:36:00.610880 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.610843 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "64334cb8-42af-401b-a93f-86ae3a36aa99" (UID: "64334cb8-42af-401b-a93f-86ae3a36aa99"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:36:00.610880 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.610856 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-model-cache" (OuterVolumeSpecName: "model-cache") pod "64334cb8-42af-401b-a93f-86ae3a36aa99" (UID: "64334cb8-42af-401b-a93f-86ae3a36aa99"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:36:00.610880 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.610867 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-home" (OuterVolumeSpecName: "home") pod "64334cb8-42af-401b-a93f-86ae3a36aa99" (UID: "64334cb8-42af-401b-a93f-86ae3a36aa99"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:36:00.611068 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.610970 2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-tmp-dir\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:36:00.611068 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.610991 2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-model-cache\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:36:00.611068 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.611004 2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-home\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:36:00.613095 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.613009 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-dshm" (OuterVolumeSpecName: "dshm") pod "64334cb8-42af-401b-a93f-86ae3a36aa99" (UID: "64334cb8-42af-401b-a93f-86ae3a36aa99"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:36:00.613095 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.613042 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64334cb8-42af-401b-a93f-86ae3a36aa99-kube-api-access-5r8j5" (OuterVolumeSpecName: "kube-api-access-5r8j5") pod "64334cb8-42af-401b-a93f-86ae3a36aa99" (UID: "64334cb8-42af-401b-a93f-86ae3a36aa99"). InnerVolumeSpecName "kube-api-access-5r8j5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:36:00.613095 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.613049 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64334cb8-42af-401b-a93f-86ae3a36aa99-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "64334cb8-42af-401b-a93f-86ae3a36aa99" (UID: "64334cb8-42af-401b-a93f-86ae3a36aa99"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:36:00.712394 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.712359 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5r8j5\" (UniqueName: \"kubernetes.io/projected/64334cb8-42af-401b-a93f-86ae3a36aa99-kube-api-access-5r8j5\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:36:00.712394 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.712386 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64334cb8-42af-401b-a93f-86ae3a36aa99-tls-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:36:00.712394 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.712396 2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64334cb8-42af-401b-a93f-86ae3a36aa99-dshm\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:36:00.736485 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.736451 2565 generic.go:356] "Generic (PLEG): container finished" podID="64334cb8-42af-401b-a93f-86ae3a36aa99" containerID="3e51a70c48ce8c9e4b0c44f05ad813a65fd1db8292674a1b326d9dadc9a1e376" exitCode=0 Jul 09 14:36:00.736706 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.736501 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" Jul 09 14:36:00.736706 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.736535 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" event={"ID":"64334cb8-42af-401b-a93f-86ae3a36aa99","Type":"ContainerDied","Data":"3e51a70c48ce8c9e4b0c44f05ad813a65fd1db8292674a1b326d9dadc9a1e376"} Jul 09 14:36:00.736706 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.736574 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp" event={"ID":"64334cb8-42af-401b-a93f-86ae3a36aa99","Type":"ContainerDied","Data":"6d84d3d4adc4b9c64fa69dd4f671dd3121d3d2f4351eddf2343e6343ee4b27b6"} Jul 09 14:36:00.736706 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.736596 2565 scope.go:117] "RemoveContainer" containerID="3e51a70c48ce8c9e4b0c44f05ad813a65fd1db8292674a1b326d9dadc9a1e376" Jul 09 14:36:00.745742 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.745728 2565 scope.go:117] "RemoveContainer" containerID="3e51a70c48ce8c9e4b0c44f05ad813a65fd1db8292674a1b326d9dadc9a1e376" Jul 09 14:36:00.746066 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:36:00.746025 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e51a70c48ce8c9e4b0c44f05ad813a65fd1db8292674a1b326d9dadc9a1e376\": container with ID starting with 3e51a70c48ce8c9e4b0c44f05ad813a65fd1db8292674a1b326d9dadc9a1e376 not found: ID does not exist" containerID="3e51a70c48ce8c9e4b0c44f05ad813a65fd1db8292674a1b326d9dadc9a1e376" Jul 09 14:36:00.746066 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.746052 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e51a70c48ce8c9e4b0c44f05ad813a65fd1db8292674a1b326d9dadc9a1e376"} err="failed to get container status \"3e51a70c48ce8c9e4b0c44f05ad813a65fd1db8292674a1b326d9dadc9a1e376\": rpc error: code = NotFound desc = could not find container \"3e51a70c48ce8c9e4b0c44f05ad813a65fd1db8292674a1b326d9dadc9a1e376\": container with ID starting with 3e51a70c48ce8c9e4b0c44f05ad813a65fd1db8292674a1b326d9dadc9a1e376 not found: ID does not exist" Jul 09 14:36:00.758707 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.758677 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp"] Jul 09 14:36:00.766572 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:00.766552 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a4b0c9/sub-test-model-a4b0c9-kserve-7c49b48d45-w9sxp"] Jul 09 14:36:01.351780 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:01.351746 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c28995d-b6af-40b7-a4ff-0d6538e50280" path="/var/lib/kubelet/pods/4c28995d-b6af-40b7-a4ff-0d6538e50280/volumes" Jul 09 14:36:01.352157 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:01.352133 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64334cb8-42af-401b-a93f-86ae3a36aa99" path="/var/lib/kubelet/pods/64334cb8-42af-401b-a93f-86ae3a36aa99/volumes" Jul 09 14:36:09.122894 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:09.122860 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:36:25.219214 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:25.219178 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:33.845510 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.845474 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2"] Jul 09 14:36:33.845920 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.845845 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64334cb8-42af-401b-a93f-86ae3a36aa99" containerName="main" Jul 09 14:36:33.845920 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.845856 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="64334cb8-42af-401b-a93f-86ae3a36aa99" containerName="main" Jul 09 14:36:33.845920 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.845874 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c28995d-b6af-40b7-a4ff-0d6538e50280" containerName="main" Jul 09 14:36:33.845920 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.845880 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c28995d-b6af-40b7-a4ff-0d6538e50280" containerName="main" Jul 09 14:36:33.846071 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.845935 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c28995d-b6af-40b7-a4ff-0d6538e50280" containerName="main" Jul 09 14:36:33.846071 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.845945 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="64334cb8-42af-401b-a93f-86ae3a36aa99" containerName="main" Jul 09 14:36:33.848720 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.848703 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:33.853159 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.853135 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a4b0c9\"/\"kube-root-ca.crt\"" Jul 09 14:36:33.853294 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.853140 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a4b0c9\"/\"rate-test-model-a4b0c9-kserve-self-signed-certs\"" Jul 09 14:36:33.853294 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.853186 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a4b0c9\"/\"openshift-service-ca.crt\"" Jul 09 14:36:33.853294 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.853185 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a4b0c9\"/\"default-dockercfg-cg567\"" Jul 09 14:36:33.864123 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.864093 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2"] Jul 09 14:36:33.884970 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.884943 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:33.887042 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.887018 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-tmp-dir\") pod \"rate-test-model-a4b0c9-kserve-74686bf879-sxrv2\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:33.887176 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.887070 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-home\") pod \"rate-test-model-a4b0c9-kserve-74686bf879-sxrv2\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:33.887176 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.887116 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llntc\" (UniqueName: \"kubernetes.io/projected/64165f16-b2aa-45d1-b364-c0924115aaa6-kube-api-access-llntc\") pod \"rate-test-model-a4b0c9-kserve-74686bf879-sxrv2\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:33.887176 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.887145 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-model-cache\") pod \"rate-test-model-a4b0c9-kserve-74686bf879-sxrv2\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:33.887287 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.887235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64165f16-b2aa-45d1-b364-c0924115aaa6-tls-certs\") pod \"rate-test-model-a4b0c9-kserve-74686bf879-sxrv2\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:33.887287 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.887279 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-dshm\") pod \"rate-test-model-a4b0c9-kserve-74686bf879-sxrv2\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:33.988865 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.988825 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-dshm\") pod \"rate-test-model-a4b0c9-kserve-74686bf879-sxrv2\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:33.989047 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.988910 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-tmp-dir\") pod \"rate-test-model-a4b0c9-kserve-74686bf879-sxrv2\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:33.989047 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.988951 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-home\") pod \"rate-test-model-a4b0c9-kserve-74686bf879-sxrv2\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:33.989047 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.988977 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llntc\" (UniqueName: \"kubernetes.io/projected/64165f16-b2aa-45d1-b364-c0924115aaa6-kube-api-access-llntc\") pod \"rate-test-model-a4b0c9-kserve-74686bf879-sxrv2\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:33.989047 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.989006 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-model-cache\") pod \"rate-test-model-a4b0c9-kserve-74686bf879-sxrv2\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:33.989271 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.989070 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64165f16-b2aa-45d1-b364-c0924115aaa6-tls-certs\") pod \"rate-test-model-a4b0c9-kserve-74686bf879-sxrv2\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:33.989370 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.989343 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-tmp-dir\") pod \"rate-test-model-a4b0c9-kserve-74686bf879-sxrv2\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:33.989452 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.989378 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-home\") pod \"rate-test-model-a4b0c9-kserve-74686bf879-sxrv2\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:33.989452 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.989414 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-model-cache\") pod \"rate-test-model-a4b0c9-kserve-74686bf879-sxrv2\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:33.991095 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.991071 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-dshm\") pod \"rate-test-model-a4b0c9-kserve-74686bf879-sxrv2\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:33.991413 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:33.991393 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64165f16-b2aa-45d1-b364-c0924115aaa6-tls-certs\") pod \"rate-test-model-a4b0c9-kserve-74686bf879-sxrv2\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:34.000085 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:34.000063 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llntc\" (UniqueName: \"kubernetes.io/projected/64165f16-b2aa-45d1-b364-c0924115aaa6-kube-api-access-llntc\") pod \"rate-test-model-a4b0c9-kserve-74686bf879-sxrv2\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:34.157957 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:34.157898 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:34.295700 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:34.295668 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2"] Jul 09 14:36:34.297296 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:36:34.297269 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64165f16_b2aa_45d1_b364_c0924115aaa6.slice/crio-f3afe8bd0ad2e85420236df9901e1dbe369641704695e0b17d01ebe438e907be WatchSource:0}: Error finding container f3afe8bd0ad2e85420236df9901e1dbe369641704695e0b17d01ebe438e907be: Status 404 returned error can't find the container with id f3afe8bd0ad2e85420236df9901e1dbe369641704695e0b17d01ebe438e907be Jul 09 14:36:34.899125 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:34.899089 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" event={"ID":"64165f16-b2aa-45d1-b364-c0924115aaa6","Type":"ContainerStarted","Data":"85bb2a425230755cac8c886183c83773f85616268d61f7570a300d0b1d3ac54e"} Jul 09 14:36:34.899125 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:34.899130 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" event={"ID":"64165f16-b2aa-45d1-b364-c0924115aaa6","Type":"ContainerStarted","Data":"f3afe8bd0ad2e85420236df9901e1dbe369641704695e0b17d01ebe438e907be"} Jul 09 14:36:34.916745 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:34.916700 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" podStartSLOduration=1.9166848939999999 podStartE2EDuration="1.916684894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:36:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:36:34.915526365 +0000 UTC m=+2294.092213657" watchObservedRunningTime="2026-07-09 14:36:34.916684894 +0000 UTC m=+2294.093372186" Jul 09 14:36:38.029661 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:38.029616 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:36:44.158768 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:44.158723 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:44.159231 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:44.158816 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:44.171347 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:44.171325 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:44.955232 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:44.955202 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:36:46.562713 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:46.562673 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:46.663051 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:46.663017 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:48.510489 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:48.510456 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:52.551189 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:52.551152 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:59.732586 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:36:59.732551 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:37:08.732377 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:08.732346 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:08.834597 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:08.834562 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:14.734387 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:14.734306 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:37:15.726488 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:15.726452 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:15.827591 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:15.827554 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:21.787524 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:21.787484 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:22.638796 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:22.638765 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2"] Jul 09 14:37:22.665184 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:22.665153 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:26.541465 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:26.541418 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7315-140081359834160"] Jul 09 14:37:26.545055 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:26.545032 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7315-140081359834160" Jul 09 14:37:26.547789 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:26.547768 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-4lxwr\"" Jul 09 14:37:26.551447 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:26.551420 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7315-140081359834160"] Jul 09 14:37:26.674011 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:26.673979 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9dw6\" (UniqueName: \"kubernetes.io/projected/faee870f-16a4-4ebd-89e4-cedfab1c3494-kube-api-access-r9dw6\") pod \"test-curl-7315-140081359834160\" (UID: \"faee870f-16a4-4ebd-89e4-cedfab1c3494\") " pod="openshift-ingress/test-curl-7315-140081359834160" Jul 09 14:37:26.775098 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:26.775068 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9dw6\" (UniqueName: \"kubernetes.io/projected/faee870f-16a4-4ebd-89e4-cedfab1c3494-kube-api-access-r9dw6\") pod \"test-curl-7315-140081359834160\" (UID: \"faee870f-16a4-4ebd-89e4-cedfab1c3494\") " pod="openshift-ingress/test-curl-7315-140081359834160" Jul 09 14:37:26.784023 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:26.783995 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9dw6\" (UniqueName: \"kubernetes.io/projected/faee870f-16a4-4ebd-89e4-cedfab1c3494-kube-api-access-r9dw6\") pod \"test-curl-7315-140081359834160\" (UID: \"faee870f-16a4-4ebd-89e4-cedfab1c3494\") " pod="openshift-ingress/test-curl-7315-140081359834160" Jul 09 14:37:26.854425 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:26.854395 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7315-140081359834160" Jul 09 14:37:26.988131 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:26.988103 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7315-140081359834160"] Jul 09 14:37:26.990448 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:37:26.990421 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfaee870f_16a4_4ebd_89e4_cedfab1c3494.slice/crio-8df54c891a07fa8e533fb200a83b059494a34da2f6c14d239e76b02fb81ab96a WatchSource:0}: Error finding container 8df54c891a07fa8e533fb200a83b059494a34da2f6c14d239e76b02fb81ab96a: Status 404 returned error can't find the container with id 8df54c891a07fa8e533fb200a83b059494a34da2f6c14d239e76b02fb81ab96a Jul 09 14:37:26.991805 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:26.991778 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:37:27.157985 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:27.157883 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7315-140081359834160" event={"ID":"faee870f-16a4-4ebd-89e4-cedfab1c3494","Type":"ContainerStarted","Data":"8df54c891a07fa8e533fb200a83b059494a34da2f6c14d239e76b02fb81ab96a"} Jul 09 14:37:28.164573 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:28.164538 2565 generic.go:356] "Generic (PLEG): container finished" podID="faee870f-16a4-4ebd-89e4-cedfab1c3494" containerID="1aa8933fac0ccf424a7c9222aac3604346db2f86840f4fa4675d076b1c7020c3" exitCode=0 Jul 09 14:37:28.164985 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:28.164615 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7315-140081359834160" event={"ID":"faee870f-16a4-4ebd-89e4-cedfab1c3494","Type":"ContainerDied","Data":"1aa8933fac0ccf424a7c9222aac3604346db2f86840f4fa4675d076b1c7020c3"} Jul 09 14:37:28.730839 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:28.730801 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:37:29.304468 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:29.304446 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7315-140081359834160" Jul 09 14:37:29.324686 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:29.324661 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7315-140081359834160_faee870f-16a4-4ebd-89e4-cedfab1c3494/test-curl-7315-140081359834160/0.log" Jul 09 14:37:29.354414 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:29.354389 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7315-140081359834160"] Jul 09 14:37:29.354554 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:29.354421 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7315-140081359834160"] Jul 09 14:37:29.400564 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:29.400530 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9dw6\" (UniqueName: \"kubernetes.io/projected/faee870f-16a4-4ebd-89e4-cedfab1c3494-kube-api-access-r9dw6\") pod \"faee870f-16a4-4ebd-89e4-cedfab1c3494\" (UID: \"faee870f-16a4-4ebd-89e4-cedfab1c3494\") " Jul 09 14:37:29.402661 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:29.402620 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faee870f-16a4-4ebd-89e4-cedfab1c3494-kube-api-access-r9dw6" (OuterVolumeSpecName: "kube-api-access-r9dw6") pod "faee870f-16a4-4ebd-89e4-cedfab1c3494" (UID: "faee870f-16a4-4ebd-89e4-cedfab1c3494"). InnerVolumeSpecName "kube-api-access-r9dw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:37:29.501914 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:29.501816 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9dw6\" (UniqueName: \"kubernetes.io/projected/faee870f-16a4-4ebd-89e4-cedfab1c3494-kube-api-access-r9dw6\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:37:29.507465 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:29.507436 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7315-140081359760096"] Jul 09 14:37:29.507822 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:29.507809 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faee870f-16a4-4ebd-89e4-cedfab1c3494" containerName="test-curl-7315-140081359834160" Jul 09 14:37:29.507880 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:29.507824 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="faee870f-16a4-4ebd-89e4-cedfab1c3494" containerName="test-curl-7315-140081359834160" Jul 09 14:37:29.507915 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:29.507890 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="faee870f-16a4-4ebd-89e4-cedfab1c3494" containerName="test-curl-7315-140081359834160" Jul 09 14:37:29.510840 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:29.510823 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7315-140081359760096" Jul 09 14:37:29.517483 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:29.517311 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7315-140081359760096"] Jul 09 14:37:29.602634 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:29.602595 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tv8d\" (UniqueName: \"kubernetes.io/projected/a7e24cca-4fc7-4242-b38f-07f78d58e9db-kube-api-access-7tv8d\") pod \"test-curl-7315-140081359760096\" (UID: \"a7e24cca-4fc7-4242-b38f-07f78d58e9db\") " pod="openshift-ingress/test-curl-7315-140081359760096" Jul 09 14:37:29.703837 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:29.703792 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tv8d\" (UniqueName: \"kubernetes.io/projected/a7e24cca-4fc7-4242-b38f-07f78d58e9db-kube-api-access-7tv8d\") pod \"test-curl-7315-140081359760096\" (UID: \"a7e24cca-4fc7-4242-b38f-07f78d58e9db\") " pod="openshift-ingress/test-curl-7315-140081359760096" Jul 09 14:37:29.712885 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:29.712860 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tv8d\" (UniqueName: \"kubernetes.io/projected/a7e24cca-4fc7-4242-b38f-07f78d58e9db-kube-api-access-7tv8d\") pod \"test-curl-7315-140081359760096\" (UID: \"a7e24cca-4fc7-4242-b38f-07f78d58e9db\") " pod="openshift-ingress/test-curl-7315-140081359760096" Jul 09 14:37:29.819799 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:29.819713 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7315-140081359760096" Jul 09 14:37:29.954225 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:29.954186 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7315-140081359760096"] Jul 09 14:37:29.956449 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:37:29.956421 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7e24cca_4fc7_4242_b38f_07f78d58e9db.slice/crio-e9c0c2a0188fa75a82875467cc1385a4b3179ce2ea9c235c6b91f6aa7fbd1b94 WatchSource:0}: Error finding container e9c0c2a0188fa75a82875467cc1385a4b3179ce2ea9c235c6b91f6aa7fbd1b94: Status 404 returned error can't find the container with id e9c0c2a0188fa75a82875467cc1385a4b3179ce2ea9c235c6b91f6aa7fbd1b94 Jul 09 14:37:30.184432 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:30.184392 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7315-140081359834160" Jul 09 14:37:30.184432 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:30.184410 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8df54c891a07fa8e533fb200a83b059494a34da2f6c14d239e76b02fb81ab96a" Jul 09 14:37:30.185663 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:30.185626 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7315-140081359760096" event={"ID":"a7e24cca-4fc7-4242-b38f-07f78d58e9db","Type":"ContainerStarted","Data":"e9c0c2a0188fa75a82875467cc1385a4b3179ce2ea9c235c6b91f6aa7fbd1b94"} Jul 09 14:37:30.194978 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:37:30.194953 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7315-140081359834160\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="faee870f-16a4-4ebd-89e4-cedfab1c3494" pod="openshift-ingress/test-curl-7315-140081359834160" Jul 09 14:37:31.192259 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:31.192225 2565 generic.go:356] "Generic (PLEG): container finished" podID="a7e24cca-4fc7-4242-b38f-07f78d58e9db" containerID="ca28df660ba8faa69007b24e4413124f3b777f80d527b14a9a28256126ed6303" exitCode=0 Jul 09 14:37:31.192876 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:31.192281 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7315-140081359760096" event={"ID":"a7e24cca-4fc7-4242-b38f-07f78d58e9db","Type":"ContainerDied","Data":"ca28df660ba8faa69007b24e4413124f3b777f80d527b14a9a28256126ed6303"} Jul 09 14:37:31.207901 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:37:31.207868 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7315-140081359834160\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="faee870f-16a4-4ebd-89e4-cedfab1c3494" pod="openshift-ingress/test-curl-7315-140081359834160" Jul 09 14:37:31.351288 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:31.351255 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faee870f-16a4-4ebd-89e4-cedfab1c3494" path="/var/lib/kubelet/pods/faee870f-16a4-4ebd-89e4-cedfab1c3494/volumes" Jul 09 14:37:31.353569 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:37:31.353546 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7315-140081359834160\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="faee870f-16a4-4ebd-89e4-cedfab1c3494" pod="openshift-ingress/test-curl-7315-140081359834160" Jul 09 14:37:32.336541 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:32.336516 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7315-140081359760096" Jul 09 14:37:32.357817 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:32.357789 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7315-140081359760096_a7e24cca-4fc7-4242-b38f-07f78d58e9db/test-curl-7315-140081359760096/0.log" Jul 09 14:37:32.381399 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:32.381373 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7315-140081359760096"] Jul 09 14:37:32.385678 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:32.385637 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7315-140081359760096"] Jul 09 14:37:32.430289 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:32.430256 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tv8d\" (UniqueName: \"kubernetes.io/projected/a7e24cca-4fc7-4242-b38f-07f78d58e9db-kube-api-access-7tv8d\") pod \"a7e24cca-4fc7-4242-b38f-07f78d58e9db\" (UID: \"a7e24cca-4fc7-4242-b38f-07f78d58e9db\") " Jul 09 14:37:32.432333 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:32.432311 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7e24cca-4fc7-4242-b38f-07f78d58e9db-kube-api-access-7tv8d" (OuterVolumeSpecName: "kube-api-access-7tv8d") pod "a7e24cca-4fc7-4242-b38f-07f78d58e9db" (UID: "a7e24cca-4fc7-4242-b38f-07f78d58e9db"). InnerVolumeSpecName "kube-api-access-7tv8d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:37:32.531638 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:32.531558 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tv8d\" (UniqueName: \"kubernetes.io/projected/a7e24cca-4fc7-4242-b38f-07f78d58e9db-kube-api-access-7tv8d\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:37:33.203147 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:33.203121 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9c0c2a0188fa75a82875467cc1385a4b3179ce2ea9c235c6b91f6aa7fbd1b94" Jul 09 14:37:33.203318 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:33.203151 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7315-140081359760096" Jul 09 14:37:33.212746 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:37:33.212706 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7315-140081359760096\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="a7e24cca-4fc7-4242-b38f-07f78d58e9db" pod="openshift-ingress/test-curl-7315-140081359760096" Jul 09 14:37:33.351830 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:33.351797 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7e24cca-4fc7-4242-b38f-07f78d58e9db" path="/var/lib/kubelet/pods/a7e24cca-4fc7-4242-b38f-07f78d58e9db/volumes" Jul 09 14:37:37.658398 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:37.658348 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" podUID="64165f16-b2aa-45d1-b364-c0924115aaa6" containerName="main" containerID="cri-o://85bb2a425230755cac8c886183c83773f85616268d61f7570a300d0b1d3ac54e" gracePeriod=45 Jul 09 14:37:37.920548 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:37.920484 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:37:38.083121 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.083084 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-tmp-dir\") pod \"64165f16-b2aa-45d1-b364-c0924115aaa6\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " Jul 09 14:37:38.083293 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.083142 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-home\") pod \"64165f16-b2aa-45d1-b364-c0924115aaa6\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " Jul 09 14:37:38.083293 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.083160 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-model-cache\") pod \"64165f16-b2aa-45d1-b364-c0924115aaa6\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " Jul 09 14:37:38.083293 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.083201 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llntc\" (UniqueName: \"kubernetes.io/projected/64165f16-b2aa-45d1-b364-c0924115aaa6-kube-api-access-llntc\") pod \"64165f16-b2aa-45d1-b364-c0924115aaa6\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " Jul 09 14:37:38.083293 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.083236 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64165f16-b2aa-45d1-b364-c0924115aaa6-tls-certs\") pod \"64165f16-b2aa-45d1-b364-c0924115aaa6\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " Jul 09 14:37:38.083293 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.083257 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-dshm\") pod \"64165f16-b2aa-45d1-b364-c0924115aaa6\" (UID: \"64165f16-b2aa-45d1-b364-c0924115aaa6\") " Jul 09 14:37:38.083562 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.083425 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "64165f16-b2aa-45d1-b364-c0924115aaa6" (UID: "64165f16-b2aa-45d1-b364-c0924115aaa6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:37:38.083562 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.083444 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-model-cache" (OuterVolumeSpecName: "model-cache") pod "64165f16-b2aa-45d1-b364-c0924115aaa6" (UID: "64165f16-b2aa-45d1-b364-c0924115aaa6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:37:38.083562 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.083462 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-home" (OuterVolumeSpecName: "home") pod "64165f16-b2aa-45d1-b364-c0924115aaa6" (UID: "64165f16-b2aa-45d1-b364-c0924115aaa6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:37:38.085394 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.085363 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64165f16-b2aa-45d1-b364-c0924115aaa6-kube-api-access-llntc" (OuterVolumeSpecName: "kube-api-access-llntc") pod "64165f16-b2aa-45d1-b364-c0924115aaa6" (UID: "64165f16-b2aa-45d1-b364-c0924115aaa6"). InnerVolumeSpecName "kube-api-access-llntc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:37:38.085509 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.085378 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64165f16-b2aa-45d1-b364-c0924115aaa6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "64165f16-b2aa-45d1-b364-c0924115aaa6" (UID: "64165f16-b2aa-45d1-b364-c0924115aaa6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:37:38.085551 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.085518 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-dshm" (OuterVolumeSpecName: "dshm") pod "64165f16-b2aa-45d1-b364-c0924115aaa6" (UID: "64165f16-b2aa-45d1-b364-c0924115aaa6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:37:38.184105 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.184018 2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-home\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:37:38.184105 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.184048 2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-model-cache\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:37:38.184105 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.184060 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llntc\" (UniqueName: \"kubernetes.io/projected/64165f16-b2aa-45d1-b364-c0924115aaa6-kube-api-access-llntc\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:37:38.184105 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.184070 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64165f16-b2aa-45d1-b364-c0924115aaa6-tls-certs\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:37:38.184105 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.184079 2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-dshm\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:37:38.184105 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.184088 2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64165f16-b2aa-45d1-b364-c0924115aaa6-tmp-dir\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:37:38.228397 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.228367 2565 generic.go:356] "Generic (PLEG): container finished" podID="64165f16-b2aa-45d1-b364-c0924115aaa6" containerID="85bb2a425230755cac8c886183c83773f85616268d61f7570a300d0b1d3ac54e" exitCode=0 Jul 09 14:37:38.228561 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.228409 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" Jul 09 14:37:38.228561 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.228459 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" event={"ID":"64165f16-b2aa-45d1-b364-c0924115aaa6","Type":"ContainerDied","Data":"85bb2a425230755cac8c886183c83773f85616268d61f7570a300d0b1d3ac54e"} Jul 09 14:37:38.228561 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.228504 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2" event={"ID":"64165f16-b2aa-45d1-b364-c0924115aaa6","Type":"ContainerDied","Data":"f3afe8bd0ad2e85420236df9901e1dbe369641704695e0b17d01ebe438e907be"} Jul 09 14:37:38.228561 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.228524 2565 scope.go:117] "RemoveContainer" containerID="85bb2a425230755cac8c886183c83773f85616268d61f7570a300d0b1d3ac54e" Jul 09 14:37:38.237179 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.237162 2565 scope.go:117] "RemoveContainer" containerID="85bb2a425230755cac8c886183c83773f85616268d61f7570a300d0b1d3ac54e" Jul 09 14:37:38.237458 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:37:38.237433 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85bb2a425230755cac8c886183c83773f85616268d61f7570a300d0b1d3ac54e\": container with ID starting with 85bb2a425230755cac8c886183c83773f85616268d61f7570a300d0b1d3ac54e not found: ID does not exist" containerID="85bb2a425230755cac8c886183c83773f85616268d61f7570a300d0b1d3ac54e" Jul 09 14:37:38.237506 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.237468 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85bb2a425230755cac8c886183c83773f85616268d61f7570a300d0b1d3ac54e"} err="failed to get container status \"85bb2a425230755cac8c886183c83773f85616268d61f7570a300d0b1d3ac54e\": rpc error: code = NotFound desc = could not find container \"85bb2a425230755cac8c886183c83773f85616268d61f7570a300d0b1d3ac54e\": container with ID starting with 85bb2a425230755cac8c886183c83773f85616268d61f7570a300d0b1d3ac54e not found: ID does not exist" Jul 09 14:37:38.249705 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.249684 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2"] Jul 09 14:37:38.254109 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.254086 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a4b0c9/rate-test-model-a4b0c9-kserve-74686bf879-sxrv2"] Jul 09 14:37:38.788606 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.788569 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7315-140081359760816"] Jul 09 14:37:38.789033 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.788971 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e24cca-4fc7-4242-b38f-07f78d58e9db" containerName="test-curl-7315-140081359760096" Jul 09 14:37:38.789033 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.788984 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e24cca-4fc7-4242-b38f-07f78d58e9db" containerName="test-curl-7315-140081359760096" Jul 09 14:37:38.789033 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.789009 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64165f16-b2aa-45d1-b364-c0924115aaa6" containerName="main" Jul 09 14:37:38.789033 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.789017 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="64165f16-b2aa-45d1-b364-c0924115aaa6" containerName="main" Jul 09 14:37:38.789164 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.789096 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="64165f16-b2aa-45d1-b364-c0924115aaa6" containerName="main" Jul 09 14:37:38.789164 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.789109 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7e24cca-4fc7-4242-b38f-07f78d58e9db" containerName="test-curl-7315-140081359760096" Jul 09 14:37:38.793605 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.793544 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7315-140081359760816" Jul 09 14:37:38.795490 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.795468 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7315-140081359760816"] Jul 09 14:37:38.796111 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.796097 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-4lxwr\"" Jul 09 14:37:38.890416 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.890379 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx727\" (UniqueName: \"kubernetes.io/projected/429cbbe3-3f0a-420e-a901-314574e31e63-kube-api-access-jx727\") pod \"test-curl-7315-140081359760816\" (UID: \"429cbbe3-3f0a-420e-a901-314574e31e63\") " pod="openshift-ingress/test-curl-7315-140081359760816" Jul 09 14:37:38.991376 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.991337 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx727\" (UniqueName: \"kubernetes.io/projected/429cbbe3-3f0a-420e-a901-314574e31e63-kube-api-access-jx727\") pod \"test-curl-7315-140081359760816\" (UID: \"429cbbe3-3f0a-420e-a901-314574e31e63\") " pod="openshift-ingress/test-curl-7315-140081359760816" Jul 09 14:37:38.999974 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:38.999946 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx727\" (UniqueName: \"kubernetes.io/projected/429cbbe3-3f0a-420e-a901-314574e31e63-kube-api-access-jx727\") pod \"test-curl-7315-140081359760816\" (UID: \"429cbbe3-3f0a-420e-a901-314574e31e63\") " pod="openshift-ingress/test-curl-7315-140081359760816" Jul 09 14:37:39.102876 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:39.102848 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7315-140081359760816" Jul 09 14:37:39.239890 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:39.239859 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7315-140081359760816"] Jul 09 14:37:39.243336 ip-10-0-136-155 kubenswrapper[2565]: W0709 14:37:39.243302 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod429cbbe3_3f0a_420e_a901_314574e31e63.slice/crio-c2053fb4c4ea54bf8c490d5e61d8c537e917b6036b034d85ec0bebf136522417 WatchSource:0}: Error finding container c2053fb4c4ea54bf8c490d5e61d8c537e917b6036b034d85ec0bebf136522417: Status 404 returned error can't find the container with id c2053fb4c4ea54bf8c490d5e61d8c537e917b6036b034d85ec0bebf136522417 Jul 09 14:37:39.351735 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:39.351701 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64165f16-b2aa-45d1-b364-c0924115aaa6" path="/var/lib/kubelet/pods/64165f16-b2aa-45d1-b364-c0924115aaa6/volumes" Jul 09 14:37:40.239526 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:40.239489 2565 generic.go:356] "Generic (PLEG): container finished" podID="429cbbe3-3f0a-420e-a901-314574e31e63" containerID="cbbc5b9d4ec614dfb232ca61780717ac4bdff7cb6c143e57bba5e5b7d9129dee" exitCode=0 Jul 09 14:37:40.239917 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:40.239577 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7315-140081359760816" event={"ID":"429cbbe3-3f0a-420e-a901-314574e31e63","Type":"ContainerDied","Data":"cbbc5b9d4ec614dfb232ca61780717ac4bdff7cb6c143e57bba5e5b7d9129dee"} Jul 09 14:37:40.239917 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:40.239621 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7315-140081359760816" event={"ID":"429cbbe3-3f0a-420e-a901-314574e31e63","Type":"ContainerStarted","Data":"c2053fb4c4ea54bf8c490d5e61d8c537e917b6036b034d85ec0bebf136522417"} Jul 09 14:37:41.379724 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:41.379701 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7315-140081359760816" Jul 09 14:37:41.399226 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:41.399194 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7315-140081359760816_429cbbe3-3f0a-420e-a901-314574e31e63/test-curl-7315-140081359760816/0.log" Jul 09 14:37:41.423576 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:41.423547 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7315-140081359760816"] Jul 09 14:37:41.429491 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:41.429465 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7315-140081359760816"] Jul 09 14:37:41.514173 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:41.514090 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jx727\" (UniqueName: \"kubernetes.io/projected/429cbbe3-3f0a-420e-a901-314574e31e63-kube-api-access-jx727\") pod \"429cbbe3-3f0a-420e-a901-314574e31e63\" (UID: \"429cbbe3-3f0a-420e-a901-314574e31e63\") " Jul 09 14:37:41.516100 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:41.516077 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/429cbbe3-3f0a-420e-a901-314574e31e63-kube-api-access-jx727" (OuterVolumeSpecName: "kube-api-access-jx727") pod "429cbbe3-3f0a-420e-a901-314574e31e63" (UID: "429cbbe3-3f0a-420e-a901-314574e31e63"). InnerVolumeSpecName "kube-api-access-jx727". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:37:41.614955 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:41.614915 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jx727\" (UniqueName: \"kubernetes.io/projected/429cbbe3-3f0a-420e-a901-314574e31e63-kube-api-access-jx727\") on node \"ip-10-0-136-155.ec2.internal\" DevicePath \"\"" Jul 09 14:37:42.249827 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:42.249787 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7315-140081359760816" Jul 09 14:37:42.249977 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:42.249805 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2053fb4c4ea54bf8c490d5e61d8c537e917b6036b034d85ec0bebf136522417" Jul 09 14:37:42.260063 ip-10-0-136-155 kubenswrapper[2565]: E0709 14:37:42.260034 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7315-140081359760816\" is forbidden: User \"system:node:ip-10-0-136-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-155.ec2.internal' and this object" podUID="429cbbe3-3f0a-420e-a901-314574e31e63" pod="openshift-ingress/test-curl-7315-140081359760816" Jul 09 14:37:42.541834 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:42.541750 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:42.606942 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:42.606898 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:43.351642 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:43.351609 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="429cbbe3-3f0a-420e-a901-314574e31e63" path="/var/lib/kubelet/pods/429cbbe3-3f0a-420e-a901-314574e31e63/volumes" Jul 09 14:37:45.927155 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:45.927115 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:37:48.472243 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:48.472206 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:48.542304 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:48.542272 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:48.902540 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:48.902473 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:49.196999 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:49.196900 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:49.385077 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:49.385035 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:49.821731 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:49.821696 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:49.924328 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:49.924294 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:50.076470 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:50.076365 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:50.194867 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:50.194831 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:56.160856 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:56.160826 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:56.256840 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:56.256801 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:56.565352 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:56.565271 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:56.792331 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:56.792298 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:57.139700 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:37:57.139663 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tcff"] Jul 09 14:38:03.034908 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:03.034868 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ggbmf_37c36d43-31a3-4a40-a544-35422438164b/manager/0.log" Jul 09 14:38:03.158028 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:03.157992 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9zg7t_94ec4d53-28dd-4152-aa68-1f6968ba6d1d/manager/0.log" Jul 09 14:38:03.402224 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:03.402192 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-9klgb_313220d7-23d4-4761-a8e8-7cbec6410999/server/0.log" Jul 09 14:38:03.524539 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:03.524501 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-j4j6m_ee3e973f-484b-48cd-9d1c-c5e6478f5389/manager/0.log" Jul 09 14:38:03.827258 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:03.827180 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78fdd99dcd-kl69n_56e355dd-5dcd-4dac-b133-74a8e7ad5000/copy-manifests/0.log" Jul 09 14:38:03.847615 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:03.847587 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78fdd99dcd-kl69n_56e355dd-5dcd-4dac-b133-74a8e7ad5000/manager/0.log" Jul 09 14:38:05.945418 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:05.945385 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5qcc9_d5f6e667-5ebe-411d-af17-52b92a6ace4e/manager/0.log" Jul 09 14:38:06.061733 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:06.061704 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-v2qdg_fcede6fc-a168-47fa-8baa-79e470fd55c5/manager/0.log" Jul 09 14:38:06.174864 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:06.174834 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9mh5j_b6be5a43-98bb-4622-8c11-6899c94bcdfa/kuadrant-console-plugin/0.log" Jul 09 14:38:06.301927 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:06.301844 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-p9qv9_72d919f5-f439-40f2-a711-82529a9eea55/registry-server/0.log" Jul 09 14:38:06.432329 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:06.432294 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5v6cz_68768865-f104-4923-be78-76f12e641b41/manager/0.log" Jul 09 14:38:06.594598 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:06.594511 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-4tcff_765da97e-6541-4498-88a3-459dd6f4d49d/limitador/0.log" Jul 09 14:38:06.724725 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:06.724680 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-x27zh_a189f6a6-725d-47e4-8542-a59f1504a766/manager/0.log" Jul 09 14:38:07.327454 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:07.327420 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78985cb57d-4cw4h_c438d803-ee70-42c6-a9d8-439de09747d6/kube-auth-proxy/0.log" Jul 09 14:38:08.557093 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:08.557046 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-km4vm_362faee8-9f0b-4716-a780-2489c60fef78/main/0.log" Jul 09 14:38:08.775108 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:08.775073 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-8gdll_3feac139-dd34-4909-946d-3a36a30f2269/main/0.log" Jul 09 14:38:08.885148 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:08.885121 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-sdrt6_2a6b5ba1-7322-4e0b-8d4f-99faf82c5f46/main/0.log" Jul 09 14:38:13.504123 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:13.504096 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:13.599363 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:13.599326 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:16.040752 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:16.040716 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tsfdc_e88b57b8-05d6-4e3f-9a01-07c5a05a31ee/global-pull-secret-syncer/0.log" Jul 09 14:38:16.139776 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:16.139740 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6b4n4_549e0930-0906-4ecd-9d31-4b6cd6a38d96/konnectivity-agent/0.log" Jul 09 14:38:16.262550 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:16.262521 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-155.ec2.internal_f671eeaf614c8d693fab4bd5bb741bfd/haproxy/0.log" Jul 09 14:38:20.941101 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:20.941071 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5qcc9_d5f6e667-5ebe-411d-af17-52b92a6ace4e/manager/0.log" Jul 09 14:38:20.967766 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:20.967724 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-v2qdg_fcede6fc-a168-47fa-8baa-79e470fd55c5/manager/0.log" Jul 09 14:38:20.992685 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:20.992636 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9mh5j_b6be5a43-98bb-4622-8c11-6899c94bcdfa/kuadrant-console-plugin/0.log" Jul 09 14:38:21.054482 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:21.054428 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-p9qv9_72d919f5-f439-40f2-a711-82529a9eea55/registry-server/0.log" Jul 09 14:38:21.220915 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:21.220824 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5v6cz_68768865-f104-4923-be78-76f12e641b41/manager/0.log" Jul 09 14:38:21.240626 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:21.240599 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-4tcff_765da97e-6541-4498-88a3-459dd6f4d49d/limitador/0.log" Jul 09 14:38:21.339692 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:21.339658 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-x27zh_a189f6a6-725d-47e4-8542-a59f1504a766/manager/0.log" Jul 09 14:38:21.415371 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:21.415339 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 14:38:21.419864 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:21.419845 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 14:38:23.296954 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:23.296861 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-57jrl_85a5f10b-677b-4651-929e-4fe3e29425cc/node-exporter/0.log" Jul 09 14:38:23.324273 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:23.324241 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-57jrl_85a5f10b-677b-4651-929e-4fe3e29425cc/kube-rbac-proxy/0.log" Jul 09 14:38:23.348239 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:23.348211 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-57jrl_85a5f10b-677b-4651-929e-4fe3e29425cc/init-textfile/0.log" Jul 09 14:38:26.342269 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.342232 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849"] Jul 09 14:38:26.342700 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.342612 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="429cbbe3-3f0a-420e-a901-314574e31e63" containerName="test-curl-7315-140081359760816" Jul 09 14:38:26.342700 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.342624 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="429cbbe3-3f0a-420e-a901-314574e31e63" containerName="test-curl-7315-140081359760816" Jul 09 14:38:26.342787 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.342711 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="429cbbe3-3f0a-420e-a901-314574e31e63" containerName="test-curl-7315-140081359760816" Jul 09 14:38:26.347757 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.347737 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:26.350354 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.350330 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4mx2l\"/\"openshift-service-ca.crt\"" Jul 09 14:38:26.350764 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.350748 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4mx2l\"/\"kube-root-ca.crt\"" Jul 09 14:38:26.351550 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.351536 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4mx2l\"/\"default-dockercfg-hwwlv\"" Jul 09 14:38:26.356224 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.356203 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849"] Jul 09 14:38:26.503425 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.503386 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/48aad33b-d169-4ce9-ad45-844997cd95ab-proc\") pod \"perf-node-gather-daemonset-nx849\" (UID: \"48aad33b-d169-4ce9-ad45-844997cd95ab\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:26.503425 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.503422 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/48aad33b-d169-4ce9-ad45-844997cd95ab-lib-modules\") pod \"perf-node-gather-daemonset-nx849\" (UID: \"48aad33b-d169-4ce9-ad45-844997cd95ab\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:26.503677 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.503526 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48aad33b-d169-4ce9-ad45-844997cd95ab-sys\") pod \"perf-node-gather-daemonset-nx849\" (UID: \"48aad33b-d169-4ce9-ad45-844997cd95ab\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:26.503677 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.503553 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/48aad33b-d169-4ce9-ad45-844997cd95ab-podres\") pod \"perf-node-gather-daemonset-nx849\" (UID: \"48aad33b-d169-4ce9-ad45-844997cd95ab\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:26.503677 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.503628 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m522j\" (UniqueName: \"kubernetes.io/projected/48aad33b-d169-4ce9-ad45-844997cd95ab-kube-api-access-m522j\") pod \"perf-node-gather-daemonset-nx849\" (UID: \"48aad33b-d169-4ce9-ad45-844997cd95ab\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:26.604736 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.604705 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/48aad33b-d169-4ce9-ad45-844997cd95ab-proc\") pod \"perf-node-gather-daemonset-nx849\" (UID: \"48aad33b-d169-4ce9-ad45-844997cd95ab\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:26.604887 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.604741 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/48aad33b-d169-4ce9-ad45-844997cd95ab-lib-modules\") pod \"perf-node-gather-daemonset-nx849\" (UID: \"48aad33b-d169-4ce9-ad45-844997cd95ab\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:26.604887 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.604786 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48aad33b-d169-4ce9-ad45-844997cd95ab-sys\") pod \"perf-node-gather-daemonset-nx849\" (UID: \"48aad33b-d169-4ce9-ad45-844997cd95ab\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:26.604887 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.604803 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/48aad33b-d169-4ce9-ad45-844997cd95ab-podres\") pod \"perf-node-gather-daemonset-nx849\" (UID: \"48aad33b-d169-4ce9-ad45-844997cd95ab\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:26.604887 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.604836 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/48aad33b-d169-4ce9-ad45-844997cd95ab-proc\") pod \"perf-node-gather-daemonset-nx849\" (UID: \"48aad33b-d169-4ce9-ad45-844997cd95ab\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:26.604887 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.604851 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m522j\" (UniqueName: \"kubernetes.io/projected/48aad33b-d169-4ce9-ad45-844997cd95ab-kube-api-access-m522j\") pod \"perf-node-gather-daemonset-nx849\" (UID: \"48aad33b-d169-4ce9-ad45-844997cd95ab\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:26.605050 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.604947 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/48aad33b-d169-4ce9-ad45-844997cd95ab-lib-modules\") pod \"perf-node-gather-daemonset-nx849\" (UID: \"48aad33b-d169-4ce9-ad45-844997cd95ab\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:26.605050 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.604960 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/48aad33b-d169-4ce9-ad45-844997cd95ab-podres\") pod \"perf-node-gather-daemonset-nx849\" (UID: \"48aad33b-d169-4ce9-ad45-844997cd95ab\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:26.605050 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.605016 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48aad33b-d169-4ce9-ad45-844997cd95ab-sys\") pod \"perf-node-gather-daemonset-nx849\" (UID: \"48aad33b-d169-4ce9-ad45-844997cd95ab\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:26.613279 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.613254 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m522j\" (UniqueName: \"kubernetes.io/projected/48aad33b-d169-4ce9-ad45-844997cd95ab-kube-api-access-m522j\") pod \"perf-node-gather-daemonset-nx849\" (UID: \"48aad33b-d169-4ce9-ad45-844997cd95ab\") " pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:26.658746 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.658717 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:26.791718 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:26.791693 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849"] Jul 09 14:38:27.166627 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:27.166528 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-fk227_46b75197-55bf-4f86-9728-c31a882dfeaf/volume-data-source-validator/0.log" Jul 09 14:38:27.471165 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:27.471066 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" event={"ID":"48aad33b-d169-4ce9-ad45-844997cd95ab","Type":"ContainerStarted","Data":"06e55cb5629f000757c32a513b95c9c3197006fff3d18781e9e3fe62a7d3dc36"} Jul 09 14:38:27.471165 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:27.471124 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" event={"ID":"48aad33b-d169-4ce9-ad45-844997cd95ab","Type":"ContainerStarted","Data":"7798e56cb9a459b3d6cf54b841e713dfc52325b56096b5674ad42516e73a6c69"} Jul 09 14:38:27.471685 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:27.471182 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:27.487111 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:27.487026 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" podStartSLOduration=1.487006109 podStartE2EDuration="1.487006109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:38:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:38:27.486301646 +0000 UTC m=+2406.662988940" watchObservedRunningTime="2026-07-09 14:38:27.487006109 +0000 UTC m=+2406.663693401" Jul 09 14:38:28.248491 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:28.248460 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vmr5k_e38de636-f2c6-43d7-ae27-77d189abfd1a/dns/0.log" Jul 09 14:38:28.272207 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:28.272181 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vmr5k_e38de636-f2c6-43d7-ae27-77d189abfd1a/kube-rbac-proxy/0.log" Jul 09 14:38:28.372660 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:28.372619 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nq5wm_f91c8d3e-09f7-4fb4-bbde-0ef27d189ca4/dns-node-resolver/0.log" Jul 09 14:38:28.941776 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:28.941743 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-66f555bfb6-m7pzn_5ed2dfcd-b9e9-4821-b71b-11c0c7dcfc0b/registry/0.log" Jul 09 14:38:28.998135 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:28.998105 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m6jmd_cc73a2bb-9ae3-47e4-9ead-1f27eb7a4b55/node-ca/0.log" Jul 09 14:38:30.104642 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:30.104604 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78985cb57d-4cw4h_c438d803-ee70-42c6-a9d8-439de09747d6/kube-auth-proxy/0.log" Jul 09 14:38:31.045399 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:31.045366 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hms6m_0985c40c-9d45-481d-acca-5d55824181c0/serve-healthcheck-canary/0.log" Jul 09 14:38:31.537387 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:31.537358 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-k9gxf_d981c93c-f315-4b00-b40c-fa777c2080da/insights-operator/0.log" Jul 09 14:38:31.540353 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:31.540333 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-k9gxf_d981c93c-f315-4b00-b40c-fa777c2080da/insights-operator/1.log" Jul 09 14:38:31.563823 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:31.563798 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k2qk9_d7a5ae4d-48d7-4c8f-8a49-3177053eab12/kube-rbac-proxy/0.log" Jul 09 14:38:31.587696 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:31.587667 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k2qk9_d7a5ae4d-48d7-4c8f-8a49-3177053eab12/exporter/0.log" Jul 09 14:38:31.611260 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:31.611238 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k2qk9_d7a5ae4d-48d7-4c8f-8a49-3177053eab12/extractor/0.log" Jul 09 14:38:33.485769 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:33.485740 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4mx2l/perf-node-gather-daemonset-nx849" Jul 09 14:38:33.945435 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:33.945404 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ggbmf_37c36d43-31a3-4a40-a544-35422438164b/manager/0.log" Jul 09 14:38:34.157909 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:34.157877 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9zg7t_94ec4d53-28dd-4152-aa68-1f6968ba6d1d/manager/0.log" Jul 09 14:38:34.267001 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:34.266917 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-9klgb_313220d7-23d4-4761-a8e8-7cbec6410999/server/0.log" Jul 09 14:38:34.368725 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:34.368697 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-j4j6m_ee3e973f-484b-48cd-9d1c-c5e6478f5389/manager/0.log" Jul 09 14:38:34.528583 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:34.528493 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78fdd99dcd-kl69n_56e355dd-5dcd-4dac-b133-74a8e7ad5000/manager/0.log" Jul 09 14:38:34.551658 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:34.551633 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78fdd99dcd-kl69n_56e355dd-5dcd-4dac-b133-74a8e7ad5000/copy-manifests/0.log" Jul 09 14:38:36.286869 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:36.286845 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78985cb57d-4cw4h_c438d803-ee70-42c6-a9d8-439de09747d6/kube-auth-proxy/0.log" Jul 09 14:38:37.964121 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:37.964085 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78985cb57d-4cw4h_c438d803-ee70-42c6-a9d8-439de09747d6/kube-auth-proxy/0.log" Jul 09 14:38:41.377579 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:41.377523 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-2kbkd_da81d043-359b-4714-af0f-24709dc95f8c/kube-storage-version-migrator-operator/1.log" Jul 09 14:38:41.379336 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:41.379307 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-2kbkd_da81d043-359b-4714-af0f-24709dc95f8c/kube-storage-version-migrator-operator/0.log" Jul 09 14:38:42.458235 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:42.458203 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jbdq5_31a27df1-dfcb-48d4-aa08-074d2ee3220b/kube-multus-additional-cni-plugins/0.log" Jul 09 14:38:42.479967 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:42.479941 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jbdq5_31a27df1-dfcb-48d4-aa08-074d2ee3220b/egress-router-binary-copy/0.log" Jul 09 14:38:42.500816 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:42.500793 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jbdq5_31a27df1-dfcb-48d4-aa08-074d2ee3220b/cni-plugins/0.log" Jul 09 14:38:42.522159 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:42.522129 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jbdq5_31a27df1-dfcb-48d4-aa08-074d2ee3220b/bond-cni-plugin/0.log" Jul 09 14:38:42.544611 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:42.544579 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jbdq5_31a27df1-dfcb-48d4-aa08-074d2ee3220b/routeoverride-cni/0.log" Jul 09 14:38:42.566956 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:42.566930 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jbdq5_31a27df1-dfcb-48d4-aa08-074d2ee3220b/whereabouts-cni-bincopy/0.log" Jul 09 14:38:42.595580 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:42.595282 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jbdq5_31a27df1-dfcb-48d4-aa08-074d2ee3220b/whereabouts-cni/0.log" Jul 09 14:38:43.002032 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:43.001938 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xgq5t_6368ef5c-3229-4983-8799-36ea627d4ee2/kube-multus/0.log" Jul 09 14:38:43.121341 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:43.121308 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q7c98_8ac5555e-e619-4a4f-974a-3597a9455f44/network-metrics-daemon/0.log" Jul 09 14:38:43.140179 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:43.140148 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q7c98_8ac5555e-e619-4a4f-974a-3597a9455f44/kube-rbac-proxy/0.log" Jul 09 14:38:44.407409 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:44.407345 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-controller/0.log" Jul 09 14:38:44.423390 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:44.423352 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/0.log" Jul 09 14:38:44.423552 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:44.423406 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovn-acl-logging/1.log" Jul 09 14:38:44.447045 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:44.447016 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/kube-rbac-proxy-node/0.log" Jul 09 14:38:44.467033 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:44.467006 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/kube-rbac-proxy-ovn-metrics/0.log" Jul 09 14:38:44.485152 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:44.485126 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/northd/0.log" Jul 09 14:38:44.504700 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:44.504679 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/nbdb/0.log" Jul 09 14:38:44.524454 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:44.524429 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/sbdb/0.log" Jul 09 14:38:44.597186 ip-10-0-136-155 kubenswrapper[2565]: I0709 14:38:44.597149 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-msflv_8934e636-88e3-45a1-abbc-f86ce7972aaa/ovnkube-controller/0.log"