Jul 08 12:01:28.493195 ip-10-0-137-232 systemd[1]: Starting Kubernetes Kubelet... Jul 08 12:01:29.274779 ip-10-0-137-232 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 12:01:29.274779 ip-10-0-137-232 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 12:01:29.274779 ip-10-0-137-232 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 12:01:29.274779 ip-10-0-137-232 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 12:01:29.274779 ip-10-0-137-232 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 12:01:29.274779 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.967368 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 12:01:29.274779 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973014 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 12:01:29.274779 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973027 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 12:01:29.274779 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973031 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 12:01:29.274779 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973034 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 12:01:29.274779 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973037 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 12:01:29.274779 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973041 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 12:01:29.274779 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973044 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 12:01:29.274779 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973046 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973049 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973052 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973055 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973058 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973061 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973063 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973066 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973069 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973072 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973075 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973077 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973080 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973082 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973085 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973087 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973090 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973092 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973095 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973098 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 12:01:29.285970 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973100 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 12:01:29.046972 ip-10-0-137-232 systemd[1]: Started Kubernetes Kubelet. Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973104 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973106 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973109 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973112 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973114 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973117 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973120 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973122 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973125 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973128 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973131 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973133 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973136 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973138 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973141 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973143 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973146 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973148 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973151 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 12:01:29.287284 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973154 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973157 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973159 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973162 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973164 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973166 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973169 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973171 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973174 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973179 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973183 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973187 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973190 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973194 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973199 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973202 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973204 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973207 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973210 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 12:01:29.288335 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973213 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973215 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973218 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973221 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973224 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973227 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973229 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973232 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973234 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973240 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973246 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973248 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973251 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973254 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973257 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973260 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973262 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973265 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973269 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 12:01:29.289214 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973272 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973275 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973277 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973280 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973283 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973286 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973288 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973291 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973293 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973295 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973298 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973300 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973303 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.973305 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974020 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974027 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974031 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974034 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974037 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 12:01:29.289962 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974041 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974046 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974049 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974052 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974057 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974060 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974065 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974069 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974072 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974075 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974078 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974081 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974085 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974088 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974091 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974094 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974096 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974099 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974102 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974105 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 12:01:29.291804 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974108 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974111 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974114 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974116 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974119 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974129 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974133 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974136 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974139 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974142 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974144 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974147 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974150 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974153 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974156 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974158 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974162 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974165 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974167 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 12:01:29.293280 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974172 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974177 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974180 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974183 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974185 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974188 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974190 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974193 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974195 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974198 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974201 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974203 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974205 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974208 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974210 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974213 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974215 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974217 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974220 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974222 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 12:01:29.295685 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974225 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974228 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974230 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974233 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974235 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974238 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974240 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974243 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974245 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974249 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974252 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974254 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974256 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974261 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974263 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974266 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974268 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974271 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974273 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974276 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 12:01:29.297655 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974278 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974280 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974283 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974286 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974288 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974291 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974293 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974296 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974298 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974301 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974303 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974306 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974308 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974311 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974313 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974756 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974761 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974764 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974766 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974774 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 12:01:29.299663 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974777 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974782 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974784 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974787 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974789 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974794 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974796 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974799 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974801 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974804 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974807 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974809 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974812 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974815 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974817 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974820 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974822 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974825 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974827 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974830 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 12:01:29.300433 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974832 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974835 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974837 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974840 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974842 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974845 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974848 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974850 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974853 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974855 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974858 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974860 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974868 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974872 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974875 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974877 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974879 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974884 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974887 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 12:01:29.302075 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974889 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974892 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974894 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974897 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974899 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974902 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974904 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974907 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974923 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974926 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974928 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974930 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974933 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974935 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974938 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974940 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974943 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974947 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974951 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 12:01:29.308930 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974954 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974957 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974960 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974962 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974965 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974969 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974971 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974985 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974989 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974992 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974994 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.974998 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975001 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975003 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975006 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975009 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975011 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975014 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975016 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975019 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 12:01:29.309576 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975021 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975024 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975027 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975029 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975032 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975034 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975037 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975039 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975042 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975044 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975048 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975051 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975054 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975057 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975065 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975068 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975149 2560 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975158 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975176 2560 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975182 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975193 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 12:01:29.310248 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975196 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975201 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975207 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975210 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975213 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975216 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975219 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975222 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975226 2560 flags.go:64] FLAG: --cgroup-root="" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975228 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975231 2560 flags.go:64] FLAG: --client-ca-file="" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975234 2560 flags.go:64] FLAG: --cloud-provider="external" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975237 2560 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975244 2560 flags.go:64] FLAG: --cluster-domain="" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975247 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975250 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975253 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975256 2560 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975260 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975263 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975266 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975269 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975272 2560 flags.go:64] FLAG: --contention-profiling="false" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975275 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 12:01:29.310797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975278 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975281 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975284 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975288 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975291 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975294 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975298 2560 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975301 2560 flags.go:64] FLAG: --enable-server="true" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975309 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975316 2560 flags.go:64] FLAG: --event-burst="100" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975321 2560 flags.go:64] FLAG: --event-qps="50" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975324 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975327 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975329 2560 flags.go:64] FLAG: --eviction-hard="" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975337 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975340 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975343 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975346 2560 flags.go:64] FLAG: --eviction-soft="" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975349 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975352 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975355 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975358 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975361 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975364 2560 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975367 2560 flags.go:64] FLAG: --feature-gates="" Jul 08 12:01:29.311474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975370 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975373 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975376 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975379 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975382 2560 flags.go:64] FLAG: --healthz-port="10248" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975385 2560 flags.go:64] FLAG: --help="false" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975387 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-137-232.ec2.internal" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975390 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975393 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975396 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975399 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975403 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975405 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975409 2560 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975412 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975415 2560 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975425 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975430 2560 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975432 2560 flags.go:64] FLAG: --kube-reserved="" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975435 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975438 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975441 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975444 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975446 2560 flags.go:64] FLAG: --lock-file="" Jul 08 12:01:29.312169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975449 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975452 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975456 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975461 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975463 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975466 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975469 2560 flags.go:64] FLAG: --logging-format="text" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975471 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975475 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975478 2560 flags.go:64] FLAG: --manifest-url="" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975480 2560 flags.go:64] FLAG: --manifest-url-header="" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975485 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975488 2560 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975492 2560 flags.go:64] FLAG: --max-pods="110" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975494 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975497 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975500 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975503 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975505 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975508 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975511 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975519 2560 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975523 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975525 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 12:01:29.312859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975528 2560 flags.go:64] FLAG: --pod-cidr="" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975538 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975543 2560 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975546 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975549 2560 flags.go:64] FLAG: --pods-per-core="0" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975552 2560 flags.go:64] FLAG: --port="10250" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975555 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975558 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06bf36f526d8276b8" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975561 2560 flags.go:64] FLAG: --qos-reserved="" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975564 2560 flags.go:64] FLAG: --read-only-port="10255" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975567 2560 flags.go:64] FLAG: --register-node="true" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975570 2560 flags.go:64] FLAG: --register-with-taints="" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975573 2560 flags.go:64] FLAG: --registry-burst="10" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975576 2560 flags.go:64] FLAG: --registry-qps="5" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975579 2560 flags.go:64] FLAG: --reserved-cpus="" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975581 2560 flags.go:64] FLAG: --reserved-memory="" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975585 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975588 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975591 2560 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975594 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975597 2560 flags.go:64] FLAG: --runonce="false" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975599 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975602 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975605 2560 flags.go:64] FLAG: --seccomp-default="false" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975608 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 12:01:29.313792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975610 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975613 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975617 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975620 2560 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975623 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975627 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975629 2560 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975632 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975636 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975645 2560 flags.go:64] FLAG: --system-cgroups="" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975648 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975653 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975656 2560 flags.go:64] FLAG: --tls-cert-file="" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975659 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975665 2560 flags.go:64] FLAG: --tls-min-version="" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975668 2560 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975671 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975673 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975676 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975679 2560 flags.go:64] FLAG: --v="2" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975683 2560 flags.go:64] FLAG: --version="false" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975687 2560 flags.go:64] FLAG: --vmodule="" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975690 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.975693 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975848 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 12:01:29.314607 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975852 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975854 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975857 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975860 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975862 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975865 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975867 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975870 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975873 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975875 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975877 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975880 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975884 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975887 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975889 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975893 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975896 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975904 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975923 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 12:01:29.454479 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975926 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975929 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975931 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975934 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975937 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975940 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975944 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975947 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975950 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975953 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975956 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975959 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975962 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975964 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975967 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975969 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975972 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975975 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975977 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975980 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 12:01:29.455217 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975982 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975985 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975988 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975990 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975993 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975996 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.975999 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976002 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976005 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976008 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976011 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976022 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976025 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976027 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976030 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976033 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976035 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976038 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976040 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976043 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 12:01:29.455754 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976046 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976048 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976052 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976055 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976058 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976061 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976064 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976066 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976069 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976073 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976076 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976079 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976081 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976084 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976086 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976089 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976092 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976095 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976098 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 12:01:29.456364 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976100 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976104 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976107 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976109 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976112 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976121 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976124 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976126 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976129 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976131 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976134 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976136 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976139 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976141 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976143 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976146 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976148 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976151 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976153 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 12:01:29.456862 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.976156 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 12:01:29.457459 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.976161 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 12:01:29.457459 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.983636 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 12:01:29.457459 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.983651 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 12:01:29.457459 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.984516 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 12:01:29.457459 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.984523 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 12:01:29.457459 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984597 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 12:01:29.457459 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984603 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 12:01:29.457459 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984606 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 12:01:29.457459 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984609 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 12:01:29.457459 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984612 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 12:01:29.457459 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984615 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 12:01:29.457459 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984618 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 12:01:29.457459 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984621 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 12:01:29.457459 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984623 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984628 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984632 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984635 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984638 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984641 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984644 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984647 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984651 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984654 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984657 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984660 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984663 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984666 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984669 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984672 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984675 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984677 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984680 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 12:01:29.457869 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984683 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984686 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984690 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984692 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984695 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984698 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984700 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984703 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984705 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984708 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984711 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984713 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984716 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984718 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984721 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984723 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984725 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984728 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984730 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984733 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 12:01:29.458444 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984736 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984738 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984741 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984743 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984746 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984748 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984751 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984753 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984760 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984764 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984767 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984770 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984773 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984776 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984779 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984783 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984785 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984788 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984791 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984793 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 12:01:29.459027 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984796 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984799 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984801 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984804 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984806 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984809 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984811 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984814 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984816 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984819 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984822 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984824 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984829 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984832 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984835 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984837 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984840 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984842 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984845 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984848 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 12:01:29.459577 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984852 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 12:01:29.460130 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984855 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 12:01:29.460130 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984857 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 12:01:29.460130 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984860 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 12:01:29.460130 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984862 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 12:01:29.460130 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984865 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 12:01:29.460130 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984868 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 12:01:29.460130 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984870 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 12:01:29.460130 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984874 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 12:01:29.460130 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984877 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 12:01:29.460130 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984879 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 12:01:29.460130 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.984882 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 12:01:29.460130 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.984887 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 12:01:29.460130 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985030 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 12:01:29.460130 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985035 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 12:01:29.460130 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985038 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985041 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985044 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985047 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985049 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985052 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985055 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985058 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985062 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985066 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985069 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985071 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985074 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985077 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985080 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985082 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985085 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985087 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985091 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985094 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 12:01:29.460569 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985096 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985099 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985101 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985104 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985107 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985109 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985112 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985116 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985120 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985122 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985125 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985128 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985130 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985133 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985136 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985138 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985141 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985144 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985146 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 12:01:29.461144 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985149 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985151 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985155 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985158 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985160 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985163 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985165 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985168 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985170 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985172 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985175 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985179 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985182 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985184 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985186 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985190 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985193 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985196 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985198 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985201 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 12:01:29.461671 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985204 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985207 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985210 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985212 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985215 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985217 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985220 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985222 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985225 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985227 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985230 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985233 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985235 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985237 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985241 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985243 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985246 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985248 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985251 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 12:01:29.462235 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985253 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 12:01:29.462791 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985256 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 12:01:29.462791 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985258 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 12:01:29.462791 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985261 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 12:01:29.462791 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985264 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 12:01:29.462791 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985267 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 12:01:29.462791 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985269 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 12:01:29.462791 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985272 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 12:01:29.462791 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985275 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 12:01:29.462791 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985277 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 08 12:01:29.462791 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985280 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 12:01:29.462791 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985282 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 12:01:29.462791 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985285 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 12:01:29.462791 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985288 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 12:01:29.462791 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985291 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 12:01:29.462791 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985293 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 12:01:29.462791 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985296 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 12:01:29.462791 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985298 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 12:01:29.462791 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:28.985301 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 12:01:29.463283 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.985306 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 12:01:29.463283 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.985405 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 12:01:29.463283 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.989808 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 12:01:29.463283 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.991440 2560 server.go:1019] "Starting client certificate rotation" Jul 08 12:01:29.463283 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.991565 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 12:01:29.463283 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.991598 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 12:01:29.463283 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.996867 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 12:01:29.463283 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:28.998082 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 12:01:29.463283 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.007535 2560 log.go:25] "Validated CRI v1 runtime API" Jul 08 12:01:29.463283 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.009888 2560 log.go:25] "Validated CRI v1 image API" Jul 08 12:01:29.463283 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.012686 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 12:01:29.463283 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.015210 2560 fs.go:135] Filesystem UUIDs: map[20a9a68b-ab77-41f5-815e-f668553fa225:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a63589eb-22b9-4304-a3b4-950a5fadad42:/dev/nvme0n1p3] Jul 08 12:01:29.463665 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.015229 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 12:01:29.463735 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.020378 2560 manager.go:216] Machine: {Timestamp:2026-07-08 12:01:29.018989295 +0000 UTC m=+0.378728593 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103186 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d1f46771504c65bb84bbbefaca21e SystemUUID:ec2d1f46-7715-04c6-5bb8-4bbbefaca21e BootID:880a5758-0348-48a9-a883-9251cd2cb472 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:43:df:69:49:2b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:43:df:69:49:2b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:e6:d2:6a:72:16 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 12:01:29.463735 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.020474 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 12:01:29.463735 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.020556 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 12:01:29.463735 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.024076 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 12:01:29.463735 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.024106 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-232.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 12:01:29.463735 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.024941 2560 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 12:01:29.463735 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.024951 2560 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 12:01:29.463735 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.024958 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.025641 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.027549 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.029363 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.032161 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.032282 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.032314 2560 kubelet.go:486] "Attempting to sync node with API server" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.032325 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.032335 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.032344 2560 kubelet.go:398] "Adding apiserver pod source" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.032354 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.032701 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.032719 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.035721 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.038425 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.038479 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.039878 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.039892 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.039898 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.039904 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.039928 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.039935 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.039944 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.039949 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.039955 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.039961 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.039978 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.039983 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.040991 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.041164 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.045969 2560 server.go:1268] "Started kubelet" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.046117 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-232.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.046151 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.046180 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.046203 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.046243 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.046302 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.048008 2560 server.go:310] "Adding debug handlers to kubelet server" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.048317 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 12:01:29.464061 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.052110 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.051270 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-232.ec2.internal.18c04ecba832a55d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-232.ec2.internal,UID:ip-10-0-137-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-232.ec2.internal,},FirstTimestamp:2026-07-08 12:01:29.045935453 +0000 UTC m=+0.405674752,LastTimestamp:2026-07-08 12:01:29.045935453 +0000 UTC m=+0.405674752,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-232.ec2.internal,}" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.058341 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.058348 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.058438 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.059111 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.059113 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.059133 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.059239 2560 reconstruct.go:97] "Volume reconstruction finished" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.059249 2560 reconciler.go:29] "Reconciler: start to sync state" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.059788 2560 factory.go:55] Registering systemd factory Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.059809 2560 factory.go:223] Registration of the systemd container factory successfully Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.060017 2560 factory.go:153] Registering CRI-O factory Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.060029 2560 factory.go:223] Registration of the crio container factory successfully Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.060067 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.060086 2560 factory.go:103] Registering Raw factory Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.060095 2560 manager.go:1196] Started watching for new ooms in manager Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.061239 2560 manager.go:349] Starting recovery of all containers Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.070218 2560 manager.go:354] Recovery completed Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.071829 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.071856 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.075577 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.077419 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientMemory" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.077452 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.077461 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientPID" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.078569 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.078603 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.078621 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.079231 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.080286 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientMemory" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.080331 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.080367 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientPID" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.080867 2560 policy_none.go:49] "None policy: Start" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.080882 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 12:01:29.465346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.080895 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.082854 2560 policy_none.go:47] "Start" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.089256 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5gz9s" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.089520 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-232.ec2.internal.18c04ecbaa135775 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-232.ec2.internal,UID:ip-10-0-137-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-232.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-232.ec2.internal,},FirstTimestamp:2026-07-08 12:01:29.077438325 +0000 UTC m=+0.437177625,LastTimestamp:2026-07-08 12:01:29.077438325 +0000 UTC m=+0.437177625,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-232.ec2.internal,}" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.092666 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-232.ec2.internal.18c04ecbaa139d33 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-232.ec2.internal,UID:ip-10-0-137-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-232.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-232.ec2.internal,},FirstTimestamp:2026-07-08 12:01:29.077456179 +0000 UTC m=+0.437195476,LastTimestamp:2026-07-08 12:01:29.077456179 +0000 UTC m=+0.437195476,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-232.ec2.internal,}" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.097573 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5gz9s" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.099059 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-232.ec2.internal.18c04ecbaa13c0cb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-232.ec2.internal,UID:ip-10-0-137-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-232.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-232.ec2.internal,},FirstTimestamp:2026-07-08 12:01:29.077465291 +0000 UTC m=+0.437204589,LastTimestamp:2026-07-08 12:01:29.077465291 +0000 UTC m=+0.437204589,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-232.ec2.internal,}" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.124839 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.126062 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.126108 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.126144 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.126186 2560 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.128433 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.137483 2560 manager.go:337] "Starting Device Plugin manager" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.137511 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.137521 2560 server.go:87] "Starting device plugin registration server" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.137802 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.137814 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.137902 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.138020 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 12:01:29.628623 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.138028 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.138557 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.138606 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-232.ec2.internal\" not found" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.226793 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal"] Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.226887 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.228657 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientMemory" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.228684 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.228698 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientPID" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.230957 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.231057 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.231098 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.234056 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientMemory" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.234080 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.234060 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientMemory" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.234092 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientPID" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.234111 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.234130 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientPID" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.236446 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.236476 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.237319 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientMemory" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.237348 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.237362 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientPID" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.238254 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.238979 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientMemory" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.239002 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.239011 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeHasSufficientPID" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.239029 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-232.ec2.internal" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.250710 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-232.ec2.internal" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.250727 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-232.ec2.internal\": node \"ip-10-0-137-232.ec2.internal\" not found" Jul 08 12:01:29.630825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.260325 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/91a2b72a6955c737e69b5bf0a1ef3214-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal\" (UID: \"91a2b72a6955c737e69b5bf0a1ef3214\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" Jul 08 12:01:29.631686 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.260357 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91a2b72a6955c737e69b5bf0a1ef3214-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal\" (UID: \"91a2b72a6955c737e69b5bf0a1ef3214\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" Jul 08 12:01:29.631686 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.260382 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fee1293dc92637ea42dbdc8f05630726-config\") pod \"kube-apiserver-proxy-ip-10-0-137-232.ec2.internal\" (UID: \"fee1293dc92637ea42dbdc8f05630726\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal" Jul 08 12:01:29.631686 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.261719 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-232.ec2.internal\" not found" node="ip-10-0-137-232.ec2.internal" Jul 08 12:01:29.631686 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.266210 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-232.ec2.internal\" not found" node="ip-10-0-137-232.ec2.internal" Jul 08 12:01:29.631686 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.268081 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 08 12:01:29.631686 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.360567 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fee1293dc92637ea42dbdc8f05630726-config\") pod \"kube-apiserver-proxy-ip-10-0-137-232.ec2.internal\" (UID: \"fee1293dc92637ea42dbdc8f05630726\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal" Jul 08 12:01:29.631686 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.360602 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/91a2b72a6955c737e69b5bf0a1ef3214-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal\" (UID: \"91a2b72a6955c737e69b5bf0a1ef3214\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" Jul 08 12:01:29.631686 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.360628 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91a2b72a6955c737e69b5bf0a1ef3214-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal\" (UID: \"91a2b72a6955c737e69b5bf0a1ef3214\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" Jul 08 12:01:29.631686 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.360667 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91a2b72a6955c737e69b5bf0a1ef3214-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal\" (UID: \"91a2b72a6955c737e69b5bf0a1ef3214\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" Jul 08 12:01:29.631686 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.360668 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fee1293dc92637ea42dbdc8f05630726-config\") pod \"kube-apiserver-proxy-ip-10-0-137-232.ec2.internal\" (UID: \"fee1293dc92637ea42dbdc8f05630726\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal" Jul 08 12:01:29.631686 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.360698 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/91a2b72a6955c737e69b5bf0a1ef3214-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal\" (UID: \"91a2b72a6955c737e69b5bf0a1ef3214\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" Jul 08 12:01:29.631686 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.368662 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 08 12:01:29.631686 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.469186 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 08 12:01:29.631686 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.566978 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" Jul 08 12:01:29.631686 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.570116 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 08 12:01:29.631686 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.570665 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal" Jul 08 12:01:29.771879 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.670239 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 08 12:01:29.771879 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.771448 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 08 12:01:29.936763 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:29.871975 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-232.ec2.internal\" not found" Jul 08 12:01:29.936763 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.898858 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.959507 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.974351 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.976622 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.986891 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.990271 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.990427 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:29.990423 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.033406 2560 apiserver.go:52] "Watching apiserver" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.053680 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.054055 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-hpnpx","openshift-network-diagnostics/network-check-target-59z9m","openshift-ovn-kubernetes/ovnkube-node-9tsxw","kube-system/global-pull-secret-syncer-6htjr","kube-system/konnectivity-agent-2f2k6","kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr","openshift-cluster-node-tuning-operator/tuned-7tfjf","openshift-dns/node-resolver-v8bfs","openshift-multus/multus-additional-cni-plugins-4pg4j","openshift-network-operator/iptables-alerter-xdd7f","openshift-image-registry/node-ca-sfqvq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal","openshift-multus/multus-nmgkq"] Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.056705 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.058810 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.058954 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xdd7f" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.062787 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.063269 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.063344 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.063363 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.063700 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p98xd\"" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.064919 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.065018 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bn55m\"" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066038 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-run-ovn\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066065 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:30.116562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066074 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-run-ovn-kubernetes\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.117558 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066104 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/00128989-fa63-42fc-82a6-dca1030bf2f5-device-dir\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.117558 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066127 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 12:01:30.117558 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.066129 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6htjr" podUID="7796cb1f-125d-4404-9bb3-bb8bb21fa848" Jul 08 12:01:30.117558 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066150 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/00128989-fa63-42fc-82a6-dca1030bf2f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.117558 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066190 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-run-systemd\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.117558 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066218 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-ovnkube-config\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.117558 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066250 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/00128989-fa63-42fc-82a6-dca1030bf2f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.117558 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066283 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63336d03-983e-4d0c-909d-670fade0e3b4-iptables-alerter-script\") pod \"iptables-alerter-xdd7f\" (UID: \"63336d03-983e-4d0c-909d-670fade0e3b4\") " pod="openshift-network-operator/iptables-alerter-xdd7f" Jul 08 12:01:30.117558 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066296 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 12:01:30.117558 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066312 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-log-socket\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.117558 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066342 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfcgh\" (UniqueName: \"kubernetes.io/projected/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-kube-api-access-lfcgh\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.117558 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066375 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/00128989-fa63-42fc-82a6-dca1030bf2f5-socket-dir\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.117558 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066406 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-slash\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.117558 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066463 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 12:01:30.117558 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066446 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-etc-openvswitch\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.118514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066512 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-run-openvswitch\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.118514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066541 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-cni-bin\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.118514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066565 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-cni-netd\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.118514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066588 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.118514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066604 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/00128989-fa63-42fc-82a6-dca1030bf2f5-registration-dir\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.118514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066630 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/00128989-fa63-42fc-82a6-dca1030bf2f5-sys-fs\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.118514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066652 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5pzt\" (UniqueName: \"kubernetes.io/projected/00128989-fa63-42fc-82a6-dca1030bf2f5-kube-api-access-z5pzt\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.118514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066668 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-var-lib-openvswitch\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.118514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066683 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-node-log\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.118514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066718 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-ovnkube-script-lib\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.118514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066741 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-env-overrides\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.118514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066757 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-ovn-node-metrics-cert\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.118514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066765 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 12:01:30.118514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066801 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066795 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63336d03-983e-4d0c-909d-670fade0e3b4-host-slash\") pod \"iptables-alerter-xdd7f\" (UID: \"63336d03-983e-4d0c-909d-670fade0e3b4\") " pod="openshift-network-operator/iptables-alerter-xdd7f" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066838 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066864 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr7wj\" (UniqueName: \"kubernetes.io/projected/63336d03-983e-4d0c-909d-670fade0e3b4-kube-api-access-qr7wj\") pod \"iptables-alerter-xdd7f\" (UID: \"63336d03-983e-4d0c-909d-670fade0e3b4\") " pod="openshift-network-operator/iptables-alerter-xdd7f" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066881 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lfkvw\"" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066889 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-kubelet\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066913 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-systemd-units\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.066953 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-run-netns\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.068282 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2f2k6" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.068886 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.069037 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.070602 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.070844 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.071073 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.071140 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-scm6v\"" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.071190 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.072939 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v8bfs" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.073245 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.073251 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w42pw\"" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.073273 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.073338 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.073361 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.075335 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.075510 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 12:01:30.119305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.078083 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.078159 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59z9m" podUID="32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.080512 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.082998 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.083067 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.084814 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2hgbt\"" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.085418 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sfqvq" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.085447 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.087598 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.087729 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.087766 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lkkn5\"" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.087877 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.088021 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.088020 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.088038 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.088783 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.088843 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vst85\"" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.089529 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-58tkw\"" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.100192 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 11:56:29 +0000 UTC" deadline="2028-02-14 17:03:05.875744871 +0000 UTC" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.100227 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14069h1m35.775522247s" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.100344 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z4q6k" Jul 08 12:01:30.120410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.109058 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z4q6k" Jul 08 12:01:30.281246 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.160042 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 12:01:30.281246 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.167562 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63336d03-983e-4d0c-909d-670fade0e3b4-iptables-alerter-script\") pod \"iptables-alerter-xdd7f\" (UID: \"63336d03-983e-4d0c-909d-670fade0e3b4\") " pod="openshift-network-operator/iptables-alerter-xdd7f" Jul 08 12:01:30.281246 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.167589 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-log-socket\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.281246 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.167610 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/765f7888-b7ce-445c-bae9-4ab60f3f55f9-tmp\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.281246 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.167633 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-host-run-multus-certs\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.281246 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.167677 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-log-socket\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.281246 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.167729 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x87q\" (UniqueName: \"kubernetes.io/projected/765f7888-b7ce-445c-bae9-4ab60f3f55f9-kube-api-access-7x87q\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.281246 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.167768 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-slash\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.281246 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.167826 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-slash\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.281246 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.167857 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-cni-bin\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.281246 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.167880 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.281246 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.167900 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret\") pod \"global-pull-secret-syncer-6htjr\" (UID: \"7796cb1f-125d-4404-9bb3-bb8bb21fa848\") " pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:30.281246 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.167930 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-multus-conf-dir\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.281246 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.167966 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5pzt\" (UniqueName: \"kubernetes.io/projected/00128989-fa63-42fc-82a6-dca1030bf2f5-kube-api-access-z5pzt\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.281246 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.167968 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.282566 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.167989 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-cni-bin\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.282566 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168076 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e398d007-962f-4661-ad5d-74798f925e45-serviceca\") pod \"node-ca-sfqvq\" (UID: \"e398d007-962f-4661-ad5d-74798f925e45\") " pod="openshift-image-registry/node-ca-sfqvq" Jul 08 12:01:30.282566 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168130 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp49p\" (UniqueName: \"kubernetes.io/projected/6343bd03-9ff5-42a1-b34c-7492789d08fa-kube-api-access-mp49p\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.282566 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168145 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63336d03-983e-4d0c-909d-670fade0e3b4-iptables-alerter-script\") pod \"iptables-alerter-xdd7f\" (UID: \"63336d03-983e-4d0c-909d-670fade0e3b4\") " pod="openshift-network-operator/iptables-alerter-xdd7f" Jul 08 12:01:30.282566 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168169 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7796cb1f-125d-4404-9bb3-bb8bb21fa848-kubelet-config\") pod \"global-pull-secret-syncer-6htjr\" (UID: \"7796cb1f-125d-4404-9bb3-bb8bb21fa848\") " pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:30.282566 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168197 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-host-run-k8s-cni-cncf-io\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.282566 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168231 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-host-run-netns\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.282566 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168253 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-hostroot\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.282566 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168272 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-var-lib-openvswitch\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.282566 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168291 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gnfp\" (UniqueName: \"kubernetes.io/projected/e398d007-962f-4661-ad5d-74798f925e45-kube-api-access-5gnfp\") pod \"node-ca-sfqvq\" (UID: \"e398d007-962f-4661-ad5d-74798f925e45\") " pod="openshift-image-registry/node-ca-sfqvq" Jul 08 12:01:30.282566 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168317 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0da5445-6313-44dc-b5e2-602b2eac0a0f-hosts-file\") pod \"node-resolver-v8bfs\" (UID: \"b0da5445-6313-44dc-b5e2-602b2eac0a0f\") " pod="openshift-dns/node-resolver-v8bfs" Jul 08 12:01:30.282566 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168335 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-var-lib-openvswitch\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.282566 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168341 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-modprobe-d\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.282566 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168370 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-var-lib-kubelet\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.283149 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168389 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6343bd03-9ff5-42a1-b34c-7492789d08fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.283149 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168406 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs\") pod \"network-metrics-daemon-hpnpx\" (UID: \"129e9e1b-586a-4226-be04-0544c26f0d9d\") " pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:30.283149 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168430 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-ovn-node-metrics-cert\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.283149 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168455 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6343bd03-9ff5-42a1-b34c-7492789d08fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.283149 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168481 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-kubelet\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.283149 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168505 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-systemd-units\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.283149 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168529 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-run-netns\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.283149 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168554 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/00128989-fa63-42fc-82a6-dca1030bf2f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.283149 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168560 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-kubelet\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.283149 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168560 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-systemd-units\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.283149 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168581 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-run-systemd\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.283149 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168596 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-run-netns\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.283149 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168606 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-ovnkube-config\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.283149 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168611 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/00128989-fa63-42fc-82a6-dca1030bf2f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.284136 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168641 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-systemd\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.284136 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168656 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-run-systemd\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.284136 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168681 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6343bd03-9ff5-42a1-b34c-7492789d08fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.284136 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168704 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-cnibin\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.284136 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168726 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/00128989-fa63-42fc-82a6-dca1030bf2f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.284136 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168745 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1214a19e-f428-485c-90c9-0c21901e40a3-cni-binary-copy\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.284136 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168770 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-etc-kubernetes\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.284136 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168795 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0da5445-6313-44dc-b5e2-602b2eac0a0f-tmp-dir\") pod \"node-resolver-v8bfs\" (UID: \"b0da5445-6313-44dc-b5e2-602b2eac0a0f\") " pod="openshift-dns/node-resolver-v8bfs" Jul 08 12:01:30.284136 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168816 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 12:01:30.284136 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168824 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phvz6\" (UniqueName: \"kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6\") pod \"network-check-target-59z9m\" (UID: \"32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75\") " pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:30.284136 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168852 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/00128989-fa63-42fc-82a6-dca1030bf2f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.284136 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168851 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfcgh\" (UniqueName: \"kubernetes.io/projected/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-kube-api-access-lfcgh\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.284136 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168888 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/00128989-fa63-42fc-82a6-dca1030bf2f5-socket-dir\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.284136 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168905 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-etc-openvswitch\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.287852 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168938 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-run-openvswitch\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.287852 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168958 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-cni-netd\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.287852 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.168974 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/00128989-fa63-42fc-82a6-dca1030bf2f5-registration-dir\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.287852 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169003 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-etc-openvswitch\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.287852 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169010 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/00128989-fa63-42fc-82a6-dca1030bf2f5-sys-fs\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.287852 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169039 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/00128989-fa63-42fc-82a6-dca1030bf2f5-socket-dir\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.287852 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169040 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-cni-netd\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.287852 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169076 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-sys\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.287852 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169080 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-run-openvswitch\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.287852 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169107 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bade0a1b-cb4c-4c2b-97dd-1d2844722dfb-agent-certs\") pod \"konnectivity-agent-2f2k6\" (UID: \"bade0a1b-cb4c-4c2b-97dd-1d2844722dfb\") " pod="kube-system/konnectivity-agent-2f2k6" Jul 08 12:01:30.287852 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169135 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bade0a1b-cb4c-4c2b-97dd-1d2844722dfb-konnectivity-ca\") pod \"konnectivity-agent-2f2k6\" (UID: \"bade0a1b-cb4c-4c2b-97dd-1d2844722dfb\") " pod="kube-system/konnectivity-agent-2f2k6" Jul 08 12:01:30.287852 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169140 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-ovnkube-config\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.287852 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169140 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/00128989-fa63-42fc-82a6-dca1030bf2f5-sys-fs\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.287852 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169141 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/00128989-fa63-42fc-82a6-dca1030bf2f5-registration-dir\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.288604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169170 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-sysctl-d\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.288604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169196 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-tuned\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.288604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169220 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6343bd03-9ff5-42a1-b34c-7492789d08fa-cnibin\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.288604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169246 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-multus-socket-dir-parent\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.288604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169274 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-host-var-lib-cni-bin\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.288604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169295 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-node-log\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.288604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169345 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-ovnkube-script-lib\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.288604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169355 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-node-log\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.288604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169372 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e398d007-962f-4661-ad5d-74798f925e45-host\") pod \"node-ca-sfqvq\" (UID: \"e398d007-962f-4661-ad5d-74798f925e45\") " pod="openshift-image-registry/node-ca-sfqvq" Jul 08 12:01:30.288604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169396 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-kubernetes\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.288604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169426 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-run\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.288604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169447 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-lib-modules\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.288604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169464 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7796cb1f-125d-4404-9bb3-bb8bb21fa848-dbus\") pod \"global-pull-secret-syncer-6htjr\" (UID: \"7796cb1f-125d-4404-9bb3-bb8bb21fa848\") " pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:30.288604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169488 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1214a19e-f428-485c-90c9-0c21901e40a3-multus-daemon-config\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.493959 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169515 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-env-overrides\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.493959 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169539 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-sysctl-conf\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.493959 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169558 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-host\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.493959 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169583 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6343bd03-9ff5-42a1-b34c-7492789d08fa-os-release\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.493959 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169601 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6343bd03-9ff5-42a1-b34c-7492789d08fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.493959 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169618 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjxvz\" (UniqueName: \"kubernetes.io/projected/1214a19e-f428-485c-90c9-0c21901e40a3-kube-api-access-mjxvz\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.493959 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169634 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63336d03-983e-4d0c-909d-670fade0e3b4-host-slash\") pod \"iptables-alerter-xdd7f\" (UID: \"63336d03-983e-4d0c-909d-670fade0e3b4\") " pod="openshift-network-operator/iptables-alerter-xdd7f" Jul 08 12:01:30.493959 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169652 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr7wj\" (UniqueName: \"kubernetes.io/projected/63336d03-983e-4d0c-909d-670fade0e3b4-kube-api-access-qr7wj\") pod \"iptables-alerter-xdd7f\" (UID: \"63336d03-983e-4d0c-909d-670fade0e3b4\") " pod="openshift-network-operator/iptables-alerter-xdd7f" Jul 08 12:01:30.493959 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169668 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-run-ovn\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.493959 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169686 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-run-ovn-kubernetes\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.493959 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169702 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/00128989-fa63-42fc-82a6-dca1030bf2f5-device-dir\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.493959 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169717 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6343bd03-9ff5-42a1-b34c-7492789d08fa-system-cni-dir\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.493959 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169735 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-os-release\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.493959 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169770 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wft7\" (UniqueName: \"kubernetes.io/projected/b0da5445-6313-44dc-b5e2-602b2eac0a0f-kube-api-access-5wft7\") pod \"node-resolver-v8bfs\" (UID: \"b0da5445-6313-44dc-b5e2-602b2eac0a0f\") " pod="openshift-dns/node-resolver-v8bfs" Jul 08 12:01:30.495357 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169785 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-sysconfig\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.495357 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169806 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb7wg\" (UniqueName: \"kubernetes.io/projected/129e9e1b-586a-4226-be04-0544c26f0d9d-kube-api-access-sb7wg\") pod \"network-metrics-daemon-hpnpx\" (UID: \"129e9e1b-586a-4226-be04-0544c26f0d9d\") " pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:30.495357 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169837 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-system-cni-dir\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.495357 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169859 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-multus-cni-dir\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.495357 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169868 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-ovnkube-script-lib\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.495357 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169874 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-host-var-lib-cni-multus\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.495357 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169917 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-host-var-lib-kubelet\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.495357 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169924 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-run-ovn\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.495357 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.169924 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-env-overrides\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.495357 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.170046 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63336d03-983e-4d0c-909d-670fade0e3b4-host-slash\") pod \"iptables-alerter-xdd7f\" (UID: \"63336d03-983e-4d0c-909d-670fade0e3b4\") " pod="openshift-network-operator/iptables-alerter-xdd7f" Jul 08 12:01:30.495357 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.170046 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-host-run-ovn-kubernetes\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.495357 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.170059 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/00128989-fa63-42fc-82a6-dca1030bf2f5-device-dir\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.495357 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.172228 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-ovn-node-metrics-cert\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.495357 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.179862 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5pzt\" (UniqueName: \"kubernetes.io/projected/00128989-fa63-42fc-82a6-dca1030bf2f5-kube-api-access-z5pzt\") pod \"aws-ebs-csi-driver-node-r5gvr\" (UID: \"00128989-fa63-42fc-82a6-dca1030bf2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.496024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.179930 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfcgh\" (UniqueName: \"kubernetes.io/projected/ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5-kube-api-access-lfcgh\") pod \"ovnkube-node-9tsxw\" (UID: \"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.496024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.186905 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr7wj\" (UniqueName: \"kubernetes.io/projected/63336d03-983e-4d0c-909d-670fade0e3b4-kube-api-access-qr7wj\") pod \"iptables-alerter-xdd7f\" (UID: \"63336d03-983e-4d0c-909d-670fade0e3b4\") " pod="openshift-network-operator/iptables-alerter-xdd7f" Jul 08 12:01:30.496024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271024 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-run\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.496024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271082 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-lib-modules\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.496024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271113 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7796cb1f-125d-4404-9bb3-bb8bb21fa848-dbus\") pod \"global-pull-secret-syncer-6htjr\" (UID: \"7796cb1f-125d-4404-9bb3-bb8bb21fa848\") " pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:30.496024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271191 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1214a19e-f428-485c-90c9-0c21901e40a3-multus-daemon-config\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.496024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271249 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-sysctl-conf\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.496024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271282 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-host\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.496024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271312 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6343bd03-9ff5-42a1-b34c-7492789d08fa-os-release\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.496024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271345 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6343bd03-9ff5-42a1-b34c-7492789d08fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.496024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271376 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjxvz\" (UniqueName: \"kubernetes.io/projected/1214a19e-f428-485c-90c9-0c21901e40a3-kube-api-access-mjxvz\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.496024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271414 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6343bd03-9ff5-42a1-b34c-7492789d08fa-system-cni-dir\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.496024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271446 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-os-release\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.496024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271473 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wft7\" (UniqueName: \"kubernetes.io/projected/b0da5445-6313-44dc-b5e2-602b2eac0a0f-kube-api-access-5wft7\") pod \"node-resolver-v8bfs\" (UID: \"b0da5445-6313-44dc-b5e2-602b2eac0a0f\") " pod="openshift-dns/node-resolver-v8bfs" Jul 08 12:01:30.496571 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271505 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-sysconfig\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.496571 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271537 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb7wg\" (UniqueName: \"kubernetes.io/projected/129e9e1b-586a-4226-be04-0544c26f0d9d-kube-api-access-sb7wg\") pod \"network-metrics-daemon-hpnpx\" (UID: \"129e9e1b-586a-4226-be04-0544c26f0d9d\") " pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:30.496571 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271541 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7796cb1f-125d-4404-9bb3-bb8bb21fa848-dbus\") pod \"global-pull-secret-syncer-6htjr\" (UID: \"7796cb1f-125d-4404-9bb3-bb8bb21fa848\") " pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:30.496571 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271571 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-system-cni-dir\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.496571 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271601 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-multus-cni-dir\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.496571 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271642 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-lib-modules\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.496571 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271627 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-host-var-lib-cni-multus\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.496571 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271682 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-host-var-lib-kubelet\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.496571 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271716 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/765f7888-b7ce-445c-bae9-4ab60f3f55f9-tmp\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.496571 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271745 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-host-run-multus-certs\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.496571 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271772 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x87q\" (UniqueName: \"kubernetes.io/projected/765f7888-b7ce-445c-bae9-4ab60f3f55f9-kube-api-access-7x87q\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.496571 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271810 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret\") pod \"global-pull-secret-syncer-6htjr\" (UID: \"7796cb1f-125d-4404-9bb3-bb8bb21fa848\") " pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:30.496571 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271840 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-multus-conf-dir\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.496571 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271870 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e398d007-962f-4661-ad5d-74798f925e45-serviceca\") pod \"node-ca-sfqvq\" (UID: \"e398d007-962f-4661-ad5d-74798f925e45\") " pod="openshift-image-registry/node-ca-sfqvq" Jul 08 12:01:30.496571 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271902 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp49p\" (UniqueName: \"kubernetes.io/projected/6343bd03-9ff5-42a1-b34c-7492789d08fa-kube-api-access-mp49p\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.497066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271932 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7796cb1f-125d-4404-9bb3-bb8bb21fa848-kubelet-config\") pod \"global-pull-secret-syncer-6htjr\" (UID: \"7796cb1f-125d-4404-9bb3-bb8bb21fa848\") " pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:30.497066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.271965 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-host-run-k8s-cni-cncf-io\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.497066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272014 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-host-run-netns\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.497066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272027 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-run\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.497066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272046 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-hostroot\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.497066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272106 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-multus-cni-dir\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.497066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272109 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-hostroot\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.497066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272140 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gnfp\" (UniqueName: \"kubernetes.io/projected/e398d007-962f-4661-ad5d-74798f925e45-kube-api-access-5gnfp\") pod \"node-ca-sfqvq\" (UID: \"e398d007-962f-4661-ad5d-74798f925e45\") " pod="openshift-image-registry/node-ca-sfqvq" Jul 08 12:01:30.497066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272166 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0da5445-6313-44dc-b5e2-602b2eac0a0f-hosts-file\") pod \"node-resolver-v8bfs\" (UID: \"b0da5445-6313-44dc-b5e2-602b2eac0a0f\") " pod="openshift-dns/node-resolver-v8bfs" Jul 08 12:01:30.497066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272167 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-host-var-lib-cni-multus\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.497066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272211 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-modprobe-d\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.497066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272234 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-var-lib-kubelet\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.497066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272256 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6343bd03-9ff5-42a1-b34c-7492789d08fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.497066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272268 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1214a19e-f428-485c-90c9-0c21901e40a3-multus-daemon-config\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.497066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272285 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs\") pod \"network-metrics-daemon-hpnpx\" (UID: \"129e9e1b-586a-4226-be04-0544c26f0d9d\") " pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:30.497577 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272313 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6343bd03-9ff5-42a1-b34c-7492789d08fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.497577 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272336 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-systemd\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.497577 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272372 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6343bd03-9ff5-42a1-b34c-7492789d08fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.497577 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272399 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-cnibin\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.497577 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272422 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1214a19e-f428-485c-90c9-0c21901e40a3-cni-binary-copy\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.497577 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272451 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-etc-kubernetes\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.497577 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272476 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0da5445-6313-44dc-b5e2-602b2eac0a0f-tmp-dir\") pod \"node-resolver-v8bfs\" (UID: \"b0da5445-6313-44dc-b5e2-602b2eac0a0f\") " pod="openshift-dns/node-resolver-v8bfs" Jul 08 12:01:30.497577 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272499 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phvz6\" (UniqueName: \"kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6\") pod \"network-check-target-59z9m\" (UID: \"32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75\") " pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:30.497577 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272574 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7796cb1f-125d-4404-9bb3-bb8bb21fa848-kubelet-config\") pod \"global-pull-secret-syncer-6htjr\" (UID: \"7796cb1f-125d-4404-9bb3-bb8bb21fa848\") " pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:30.497577 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272629 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-sys\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.497577 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272667 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bade0a1b-cb4c-4c2b-97dd-1d2844722dfb-agent-certs\") pod \"konnectivity-agent-2f2k6\" (UID: \"bade0a1b-cb4c-4c2b-97dd-1d2844722dfb\") " pod="kube-system/konnectivity-agent-2f2k6" Jul 08 12:01:30.497577 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272683 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-host-run-multus-certs\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.497577 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272700 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bade0a1b-cb4c-4c2b-97dd-1d2844722dfb-konnectivity-ca\") pod \"konnectivity-agent-2f2k6\" (UID: \"bade0a1b-cb4c-4c2b-97dd-1d2844722dfb\") " pod="kube-system/konnectivity-agent-2f2k6" Jul 08 12:01:30.497577 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272766 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-sysctl-d\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.497577 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272803 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-sys\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.498168 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272804 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-tuned\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.498168 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272846 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6343bd03-9ff5-42a1-b34c-7492789d08fa-cnibin\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.498168 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272867 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6343bd03-9ff5-42a1-b34c-7492789d08fa-os-release\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.498168 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272880 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-multus-socket-dir-parent\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.498168 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272929 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-multus-socket-dir-parent\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.498168 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.272946 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-host-var-lib-cni-bin\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.498168 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.273003 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e398d007-962f-4661-ad5d-74798f925e45-host\") pod \"node-ca-sfqvq\" (UID: \"e398d007-962f-4661-ad5d-74798f925e45\") " pod="openshift-image-registry/node-ca-sfqvq" Jul 08 12:01:30.498168 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.273040 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-kubernetes\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.498168 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.273182 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-host-run-k8s-cni-cncf-io\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.498168 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.273526 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 12:01:30.498168 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.273529 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-kubernetes\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.498168 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.273584 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-host-run-netns\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.498168 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.273616 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret podName:7796cb1f-125d-4404-9bb3-bb8bb21fa848 nodeName:}" failed. No retries permitted until 2026-07-08 12:01:30.77358225 +0000 UTC m=+2.133321556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret") pod "global-pull-secret-syncer-6htjr" (UID: "7796cb1f-125d-4404-9bb3-bb8bb21fa848") : object "kube-system"/"original-pull-secret" not registered Jul 08 12:01:30.498168 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.273667 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-multus-conf-dir\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.498691 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.274174 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6343bd03-9ff5-42a1-b34c-7492789d08fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.498691 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.274245 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bade0a1b-cb4c-4c2b-97dd-1d2844722dfb-konnectivity-ca\") pod \"konnectivity-agent-2f2k6\" (UID: \"bade0a1b-cb4c-4c2b-97dd-1d2844722dfb\") " pod="kube-system/konnectivity-agent-2f2k6" Jul 08 12:01:30.498691 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.274399 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-sysctl-d\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.498691 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.274474 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6343bd03-9ff5-42a1-b34c-7492789d08fa-system-cni-dir\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.498691 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.274545 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-sysctl-conf\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.498691 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.274556 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-os-release\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.498691 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.274838 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-sysconfig\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.498691 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.275105 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1214a19e-f428-485c-90c9-0c21901e40a3-cni-binary-copy\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.498691 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.275160 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-system-cni-dir\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.498691 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.275164 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-etc-kubernetes\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.498691 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.275447 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0da5445-6313-44dc-b5e2-602b2eac0a0f-hosts-file\") pod \"node-resolver-v8bfs\" (UID: \"b0da5445-6313-44dc-b5e2-602b2eac0a0f\") " pod="openshift-dns/node-resolver-v8bfs" Jul 08 12:01:30.498691 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.275512 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-host-var-lib-kubelet\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.498691 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.275527 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0da5445-6313-44dc-b5e2-602b2eac0a0f-tmp-dir\") pod \"node-resolver-v8bfs\" (UID: \"b0da5445-6313-44dc-b5e2-602b2eac0a0f\") " pod="openshift-dns/node-resolver-v8bfs" Jul 08 12:01:30.498691 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.275588 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-host-var-lib-cni-bin\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.498691 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.275605 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6343bd03-9ff5-42a1-b34c-7492789d08fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.499186 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.275647 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e398d007-962f-4661-ad5d-74798f925e45-host\") pod \"node-ca-sfqvq\" (UID: \"e398d007-962f-4661-ad5d-74798f925e45\") " pod="openshift-image-registry/node-ca-sfqvq" Jul 08 12:01:30.499186 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.275652 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6343bd03-9ff5-42a1-b34c-7492789d08fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.499186 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.275681 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-systemd\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.499186 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.275706 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-host\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.499186 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.275787 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1214a19e-f428-485c-90c9-0c21901e40a3-cnibin\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.499186 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.275840 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-var-lib-kubelet\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.499186 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.275884 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e398d007-962f-4661-ad5d-74798f925e45-serviceca\") pod \"node-ca-sfqvq\" (UID: \"e398d007-962f-4661-ad5d-74798f925e45\") " pod="openshift-image-registry/node-ca-sfqvq" Jul 08 12:01:30.499186 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.275934 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 12:01:30.499186 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.276027 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs podName:129e9e1b-586a-4226-be04-0544c26f0d9d nodeName:}" failed. No retries permitted until 2026-07-08 12:01:30.77600936 +0000 UTC m=+2.135748661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs") pod "network-metrics-daemon-hpnpx" (UID: "129e9e1b-586a-4226-be04-0544c26f0d9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 12:01:30.499186 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.276085 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/765f7888-b7ce-445c-bae9-4ab60f3f55f9-tmp\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.499186 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.276111 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-modprobe-d\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.499186 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.276195 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6343bd03-9ff5-42a1-b34c-7492789d08fa-cnibin\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.499186 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.276232 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/765f7888-b7ce-445c-bae9-4ab60f3f55f9-etc-tuned\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.499186 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.276376 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6343bd03-9ff5-42a1-b34c-7492789d08fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.499186 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.276560 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bade0a1b-cb4c-4c2b-97dd-1d2844722dfb-agent-certs\") pod \"konnectivity-agent-2f2k6\" (UID: \"bade0a1b-cb4c-4c2b-97dd-1d2844722dfb\") " pod="kube-system/konnectivity-agent-2f2k6" Jul 08 12:01:30.499725 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.281698 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 12:01:30.499725 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.281753 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 12:01:30.499725 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.281811 2560 projected.go:196] Error preparing data for projected volume kube-api-access-phvz6 for pod openshift-network-diagnostics/network-check-target-59z9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 12:01:30.499725 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.281877 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6 podName:32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75 nodeName:}" failed. No retries permitted until 2026-07-08 12:01:30.78185999 +0000 UTC m=+2.141599299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-phvz6" (UniqueName: "kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6") pod "network-check-target-59z9m" (UID: "32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 12:01:30.499725 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.285896 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb7wg\" (UniqueName: \"kubernetes.io/projected/129e9e1b-586a-4226-be04-0544c26f0d9d-kube-api-access-sb7wg\") pod \"network-metrics-daemon-hpnpx\" (UID: \"129e9e1b-586a-4226-be04-0544c26f0d9d\") " pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:30.499725 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.286688 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjxvz\" (UniqueName: \"kubernetes.io/projected/1214a19e-f428-485c-90c9-0c21901e40a3-kube-api-access-mjxvz\") pod \"multus-nmgkq\" (UID: \"1214a19e-f428-485c-90c9-0c21901e40a3\") " pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.499725 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.288047 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x87q\" (UniqueName: \"kubernetes.io/projected/765f7888-b7ce-445c-bae9-4ab60f3f55f9-kube-api-access-7x87q\") pod \"tuned-7tfjf\" (UID: \"765f7888-b7ce-445c-bae9-4ab60f3f55f9\") " pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.499725 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.288059 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp49p\" (UniqueName: \"kubernetes.io/projected/6343bd03-9ff5-42a1-b34c-7492789d08fa-kube-api-access-mp49p\") pod \"multus-additional-cni-plugins-4pg4j\" (UID: \"6343bd03-9ff5-42a1-b34c-7492789d08fa\") " pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.499725 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.289998 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wft7\" (UniqueName: \"kubernetes.io/projected/b0da5445-6313-44dc-b5e2-602b2eac0a0f-kube-api-access-5wft7\") pod \"node-resolver-v8bfs\" (UID: \"b0da5445-6313-44dc-b5e2-602b2eac0a0f\") " pod="openshift-dns/node-resolver-v8bfs" Jul 08 12:01:30.499725 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.290296 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gnfp\" (UniqueName: \"kubernetes.io/projected/e398d007-962f-4661-ad5d-74798f925e45-kube-api-access-5gnfp\") pod \"node-ca-sfqvq\" (UID: \"e398d007-962f-4661-ad5d-74798f925e45\") " pod="openshift-image-registry/node-ca-sfqvq" Jul 08 12:01:30.499725 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.390748 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" Jul 08 12:01:30.499725 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.390843 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xdd7f" Jul 08 12:01:30.499725 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.426163 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:30.499725 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.428873 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2f2k6" Jul 08 12:01:30.499725 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.462903 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nmgkq" Jul 08 12:01:30.499725 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.468060 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v8bfs" Jul 08 12:01:30.499725 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.487417 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" Jul 08 12:01:30.637021 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.512712 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4pg4j" Jul 08 12:01:30.637021 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.517648 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sfqvq" Jul 08 12:01:30.637021 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.534290 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 12:01:30.816611 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.644916 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 12:01:30.816611 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:30.744972 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a2b72a6955c737e69b5bf0a1ef3214.slice/crio-141cf5e7cbf90f98028f6ae4c2da9a0260dc67a867f44bb2dcd9d852e9389535 WatchSource:0}: Error finding container 141cf5e7cbf90f98028f6ae4c2da9a0260dc67a867f44bb2dcd9d852e9389535: Status 404 returned error can't find the container with id 141cf5e7cbf90f98028f6ae4c2da9a0260dc67a867f44bb2dcd9d852e9389535 Jul 08 12:01:30.816611 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.750561 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 12:01:30.816611 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.777480 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret\") pod \"global-pull-secret-syncer-6htjr\" (UID: \"7796cb1f-125d-4404-9bb3-bb8bb21fa848\") " pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:30.816611 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.777516 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs\") pod \"network-metrics-daemon-hpnpx\" (UID: \"129e9e1b-586a-4226-be04-0544c26f0d9d\") " pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:30.816611 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.777632 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 12:01:30.816611 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.777657 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 12:01:30.816611 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.777726 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs podName:129e9e1b-586a-4226-be04-0544c26f0d9d nodeName:}" failed. No retries permitted until 2026-07-08 12:01:31.777704371 +0000 UTC m=+3.137443674 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs") pod "network-metrics-daemon-hpnpx" (UID: "129e9e1b-586a-4226-be04-0544c26f0d9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 12:01:30.816611 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.777747 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret podName:7796cb1f-125d-4404-9bb3-bb8bb21fa848 nodeName:}" failed. No retries permitted until 2026-07-08 12:01:31.777737316 +0000 UTC m=+3.137476605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret") pod "global-pull-secret-syncer-6htjr" (UID: "7796cb1f-125d-4404-9bb3-bb8bb21fa848") : object "kube-system"/"original-pull-secret" not registered Jul 08 12:01:30.816611 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:30.794182 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbade0a1b_cb4c_4c2b_97dd_1d2844722dfb.slice/crio-6c7077682ae4f0a2cbbac9868fcb1b3a29b589f0a0b7b3114681f0678dd8b60c WatchSource:0}: Error finding container 6c7077682ae4f0a2cbbac9868fcb1b3a29b589f0a0b7b3114681f0678dd8b60c: Status 404 returned error can't find the container with id 6c7077682ae4f0a2cbbac9868fcb1b3a29b589f0a0b7b3114681f0678dd8b60c Jul 08 12:01:30.961666 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:30.878589 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phvz6\" (UniqueName: \"kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6\") pod \"network-check-target-59z9m\" (UID: \"32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75\") " pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:30.961666 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.878733 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 12:01:30.961666 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.878751 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 12:01:30.961666 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.878762 2560 projected.go:196] Error preparing data for projected volume kube-api-access-phvz6 for pod openshift-network-diagnostics/network-check-target-59z9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 12:01:30.961666 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:30.878819 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6 podName:32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75 nodeName:}" failed. No retries permitted until 2026-07-08 12:01:31.878803763 +0000 UTC m=+3.238543071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-phvz6" (UniqueName: "kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6") pod "network-check-target-59z9m" (UID: "32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 12:01:31.068242 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:31.051421 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6343bd03_9ff5_42a1_b34c_7492789d08fa.slice/crio-6be0c451de515cf6003342b7b49458ce3b6fc6b66f95c5fbe4ee5c0000eb4f18 WatchSource:0}: Error finding container 6be0c451de515cf6003342b7b49458ce3b6fc6b66f95c5fbe4ee5c0000eb4f18: Status 404 returned error can't find the container with id 6be0c451de515cf6003342b7b49458ce3b6fc6b66f95c5fbe4ee5c0000eb4f18 Jul 08 12:01:31.220640 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:31.111322 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4bc322_5a8c_49dd_9897_0ec0fa8f2ef5.slice/crio-877a40c0ef81d0ce7ad535c2047b13d3ea030d05440aec3e29da071b38b4dcae WatchSource:0}: Error finding container 877a40c0ef81d0ce7ad535c2047b13d3ea030d05440aec3e29da071b38b4dcae: Status 404 returned error can't find the container with id 877a40c0ef81d0ce7ad535c2047b13d3ea030d05440aec3e29da071b38b4dcae Jul 08 12:01:31.220640 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:31.117567 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 11:56:30 +0000 UTC" deadline="2028-04-10 13:47:46.23351696 +0000 UTC" Jul 08 12:01:31.220640 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:31.117917 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15409h46m15.115604601s" Jul 08 12:01:31.220640 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:31.127005 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:31.220640 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:31.127124 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:01:31.220640 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:31.131368 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sfqvq" event={"ID":"e398d007-962f-4661-ad5d-74798f925e45","Type":"ContainerStarted","Data":"60319eb77b884c6da0fd4c8647aa8563fabd698c5f51c585366a9ffdf28f3e67"} Jul 08 12:01:31.220640 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:31.132188 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v8bfs" event={"ID":"b0da5445-6313-44dc-b5e2-602b2eac0a0f","Type":"ContainerStarted","Data":"77f90f1ef8c9d77c8458fce164d4d5f2a4a21c32e148d13759432bf37729b05f"} Jul 08 12:01:31.220640 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:31.133031 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2f2k6" event={"ID":"bade0a1b-cb4c-4c2b-97dd-1d2844722dfb","Type":"ContainerStarted","Data":"6c7077682ae4f0a2cbbac9868fcb1b3a29b589f0a0b7b3114681f0678dd8b60c"} Jul 08 12:01:31.220640 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:31.133879 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" event={"ID":"91a2b72a6955c737e69b5bf0a1ef3214","Type":"ContainerStarted","Data":"141cf5e7cbf90f98028f6ae4c2da9a0260dc67a867f44bb2dcd9d852e9389535"} Jul 08 12:01:31.220640 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:31.134905 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" event={"ID":"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5","Type":"ContainerStarted","Data":"877a40c0ef81d0ce7ad535c2047b13d3ea030d05440aec3e29da071b38b4dcae"} Jul 08 12:01:31.220640 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:31.135951 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4pg4j" event={"ID":"6343bd03-9ff5-42a1-b34c-7492789d08fa","Type":"ContainerStarted","Data":"6be0c451de515cf6003342b7b49458ce3b6fc6b66f95c5fbe4ee5c0000eb4f18"} Jul 08 12:01:31.220640 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:31.136949 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" event={"ID":"765f7888-b7ce-445c-bae9-4ab60f3f55f9","Type":"ContainerStarted","Data":"6fd811dc53b3b47d6879527c8f75e50e9baec391ecf775c4ec129e68bc7f076c"} Jul 08 12:01:31.220640 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:31.137851 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nmgkq" event={"ID":"1214a19e-f428-485c-90c9-0c21901e40a3","Type":"ContainerStarted","Data":"9e86d716af89b43ec17e1918285a120e2ce0933d72c137e23aca1e2ac47e3abb"} Jul 08 12:01:31.220640 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:31.200176 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63336d03_983e_4d0c_909d_670fade0e3b4.slice/crio-10e7efb8c0b355debbcd550a9a11c6711263884f63aecd4c8fc0abe840734fbe WatchSource:0}: Error finding container 10e7efb8c0b355debbcd550a9a11c6711263884f63aecd4c8fc0abe840734fbe: Status 404 returned error can't find the container with id 10e7efb8c0b355debbcd550a9a11c6711263884f63aecd4c8fc0abe840734fbe Jul 08 12:01:31.384672 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:31.302421 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00128989_fa63_42fc_82a6_dca1030bf2f5.slice/crio-50846ff237795ebd8e78328b92923ffa4afcf7639741d794a7b804bf281fad80 WatchSource:0}: Error finding container 50846ff237795ebd8e78328b92923ffa4afcf7639741d794a7b804bf281fad80: Status 404 returned error can't find the container with id 50846ff237795ebd8e78328b92923ffa4afcf7639741d794a7b804bf281fad80 Jul 08 12:01:31.568240 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:31.557240 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 12:01:31.814024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:31.813974 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 12:01:31.859417 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:31.858505 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret\") pod \"global-pull-secret-syncer-6htjr\" (UID: \"7796cb1f-125d-4404-9bb3-bb8bb21fa848\") " pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:31.859417 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:31.858569 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs\") pod \"network-metrics-daemon-hpnpx\" (UID: \"129e9e1b-586a-4226-be04-0544c26f0d9d\") " pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:31.859417 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:31.858719 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 12:01:31.859417 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:31.858817 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs podName:129e9e1b-586a-4226-be04-0544c26f0d9d nodeName:}" failed. No retries permitted until 2026-07-08 12:01:33.858794284 +0000 UTC m=+5.218533586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs") pod "network-metrics-daemon-hpnpx" (UID: "129e9e1b-586a-4226-be04-0544c26f0d9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 12:01:31.859417 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:31.859267 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 12:01:31.859417 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:31.859331 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret podName:7796cb1f-125d-4404-9bb3-bb8bb21fa848 nodeName:}" failed. No retries permitted until 2026-07-08 12:01:33.859311105 +0000 UTC m=+5.219050407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret") pod "global-pull-secret-syncer-6htjr" (UID: "7796cb1f-125d-4404-9bb3-bb8bb21fa848") : object "kube-system"/"original-pull-secret" not registered Jul 08 12:01:31.960151 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:31.959381 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phvz6\" (UniqueName: \"kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6\") pod \"network-check-target-59z9m\" (UID: \"32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75\") " pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:31.960151 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:31.959585 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 12:01:31.960151 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:31.959607 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 12:01:31.960151 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:31.959622 2560 projected.go:196] Error preparing data for projected volume kube-api-access-phvz6 for pod openshift-network-diagnostics/network-check-target-59z9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 12:01:31.960151 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:31.959684 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6 podName:32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75 nodeName:}" failed. No retries permitted until 2026-07-08 12:01:33.959664528 +0000 UTC m=+5.319403820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-phvz6" (UniqueName: "kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6") pod "network-check-target-59z9m" (UID: "32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 12:01:32.118187 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:32.118085 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 11:56:30 +0000 UTC" deadline="2028-03-03 11:33:41.948055201 +0000 UTC" Jul 08 12:01:32.118187 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:32.118135 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14495h32m9.829926127s" Jul 08 12:01:32.126686 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:32.126653 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:32.126842 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:32.126795 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6htjr" podUID="7796cb1f-125d-4404-9bb3-bb8bb21fa848" Jul 08 12:01:32.127271 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:32.127235 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:32.127368 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:32.127343 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59z9m" podUID="32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75" Jul 08 12:01:32.152631 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:32.152508 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" event={"ID":"00128989-fa63-42fc-82a6-dca1030bf2f5","Type":"ContainerStarted","Data":"50846ff237795ebd8e78328b92923ffa4afcf7639741d794a7b804bf281fad80"} Jul 08 12:01:32.164484 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:32.164448 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xdd7f" event={"ID":"63336d03-983e-4d0c-909d-670fade0e3b4","Type":"ContainerStarted","Data":"10e7efb8c0b355debbcd550a9a11c6711263884f63aecd4c8fc0abe840734fbe"} Jul 08 12:01:33.127445 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:33.126898 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:33.127445 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:33.127079 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:01:33.876514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:33.876201 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret\") pod \"global-pull-secret-syncer-6htjr\" (UID: \"7796cb1f-125d-4404-9bb3-bb8bb21fa848\") " pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:33.876514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:33.876262 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs\") pod \"network-metrics-daemon-hpnpx\" (UID: \"129e9e1b-586a-4226-be04-0544c26f0d9d\") " pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:33.876514 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:33.876352 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 12:01:33.876514 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:33.876377 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 12:01:33.876514 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:33.876415 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs podName:129e9e1b-586a-4226-be04-0544c26f0d9d nodeName:}" failed. No retries permitted until 2026-07-08 12:01:37.876399409 +0000 UTC m=+9.236138693 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs") pod "network-metrics-daemon-hpnpx" (UID: "129e9e1b-586a-4226-be04-0544c26f0d9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 12:01:33.876514 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:33.876433 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret podName:7796cb1f-125d-4404-9bb3-bb8bb21fa848 nodeName:}" failed. No retries permitted until 2026-07-08 12:01:37.876422966 +0000 UTC m=+9.236162251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret") pod "global-pull-secret-syncer-6htjr" (UID: "7796cb1f-125d-4404-9bb3-bb8bb21fa848") : object "kube-system"/"original-pull-secret" not registered Jul 08 12:01:33.977110 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:33.976963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phvz6\" (UniqueName: \"kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6\") pod \"network-check-target-59z9m\" (UID: \"32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75\") " pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:33.977300 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:33.977153 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 12:01:33.977300 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:33.977181 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 12:01:33.977300 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:33.977197 2560 projected.go:196] Error preparing data for projected volume kube-api-access-phvz6 for pod openshift-network-diagnostics/network-check-target-59z9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 12:01:33.977300 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:33.977257 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6 podName:32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75 nodeName:}" failed. No retries permitted until 2026-07-08 12:01:37.9772373 +0000 UTC m=+9.336976588 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-phvz6" (UniqueName: "kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6") pod "network-check-target-59z9m" (UID: "32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 12:01:34.127144 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:34.127063 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:34.127300 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:34.127206 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6htjr" podUID="7796cb1f-125d-4404-9bb3-bb8bb21fa848" Jul 08 12:01:34.127530 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:34.127063 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:34.128052 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:34.127663 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59z9m" podUID="32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75" Jul 08 12:01:35.131543 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:35.131512 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:35.132007 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:35.131689 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:01:36.127116 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:36.127057 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:36.127316 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:36.127208 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6htjr" podUID="7796cb1f-125d-4404-9bb3-bb8bb21fa848" Jul 08 12:01:36.127654 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:36.127627 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:36.127755 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:36.127734 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59z9m" podUID="32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75" Jul 08 12:01:37.127376 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:37.127340 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:37.127810 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:37.127495 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:01:37.909082 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:37.908835 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret\") pod \"global-pull-secret-syncer-6htjr\" (UID: \"7796cb1f-125d-4404-9bb3-bb8bb21fa848\") " pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:37.909082 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:37.908907 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs\") pod \"network-metrics-daemon-hpnpx\" (UID: \"129e9e1b-586a-4226-be04-0544c26f0d9d\") " pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:37.909304 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:37.909137 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 12:01:37.909304 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:37.909151 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 12:01:37.909304 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:37.909204 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs podName:129e9e1b-586a-4226-be04-0544c26f0d9d nodeName:}" failed. No retries permitted until 2026-07-08 12:01:45.909184834 +0000 UTC m=+17.268924125 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs") pod "network-metrics-daemon-hpnpx" (UID: "129e9e1b-586a-4226-be04-0544c26f0d9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 12:01:37.909304 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:37.909222 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret podName:7796cb1f-125d-4404-9bb3-bb8bb21fa848 nodeName:}" failed. No retries permitted until 2026-07-08 12:01:45.909213628 +0000 UTC m=+17.268952912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret") pod "global-pull-secret-syncer-6htjr" (UID: "7796cb1f-125d-4404-9bb3-bb8bb21fa848") : object "kube-system"/"original-pull-secret" not registered Jul 08 12:01:38.010210 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:38.010094 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phvz6\" (UniqueName: \"kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6\") pod \"network-check-target-59z9m\" (UID: \"32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75\") " pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:38.010401 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:38.010265 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 12:01:38.010401 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:38.010288 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 12:01:38.010401 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:38.010299 2560 projected.go:196] Error preparing data for projected volume kube-api-access-phvz6 for pod openshift-network-diagnostics/network-check-target-59z9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 12:01:38.010401 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:38.010362 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6 podName:32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75 nodeName:}" failed. No retries permitted until 2026-07-08 12:01:46.01034374 +0000 UTC m=+17.370083031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-phvz6" (UniqueName: "kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6") pod "network-check-target-59z9m" (UID: "32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 12:01:38.126411 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:38.126302 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:38.126411 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:38.126341 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:38.126635 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:38.126439 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6htjr" podUID="7796cb1f-125d-4404-9bb3-bb8bb21fa848" Jul 08 12:01:38.126635 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:38.126578 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59z9m" podUID="32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75" Jul 08 12:01:39.127394 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:39.127359 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:39.127841 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:39.127493 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:01:40.126927 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:40.126868 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:40.127123 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:40.127010 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6htjr" podUID="7796cb1f-125d-4404-9bb3-bb8bb21fa848" Jul 08 12:01:40.127452 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:40.127427 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:40.127809 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:40.127522 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59z9m" podUID="32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75" Jul 08 12:01:41.126936 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:41.126889 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:41.127095 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:41.127061 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:01:41.542636 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:01:41.542609 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee1293dc92637ea42dbdc8f05630726.slice/crio-b777b4a8037a0baea386b6ffd49624ecfcddbed127b29906ce81947d08c6f3c1 WatchSource:0}: Error finding container b777b4a8037a0baea386b6ffd49624ecfcddbed127b29906ce81947d08c6f3c1: Status 404 returned error can't find the container with id b777b4a8037a0baea386b6ffd49624ecfcddbed127b29906ce81947d08c6f3c1 Jul 08 12:01:42.127361 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:42.127119 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:42.127528 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:42.127163 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:42.127528 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:42.127470 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59z9m" podUID="32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75" Jul 08 12:01:42.127640 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:42.127539 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6htjr" podUID="7796cb1f-125d-4404-9bb3-bb8bb21fa848" Jul 08 12:01:42.188120 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:42.188022 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sfqvq" event={"ID":"e398d007-962f-4661-ad5d-74798f925e45","Type":"ContainerStarted","Data":"0f073eb29893af75ceca41b1ec2e3c43a3594e060e111aba326feb669a79c360"} Jul 08 12:01:42.189966 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:42.189907 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" event={"ID":"00128989-fa63-42fc-82a6-dca1030bf2f5","Type":"ContainerStarted","Data":"c16fff5fe213ec1cdfc4f22c251b331fb3ef5d78d5af972923515464f2c6b366"} Jul 08 12:01:42.191123 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:42.191089 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal" event={"ID":"fee1293dc92637ea42dbdc8f05630726","Type":"ContainerStarted","Data":"b777b4a8037a0baea386b6ffd49624ecfcddbed127b29906ce81947d08c6f3c1"} Jul 08 12:01:42.193722 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:42.193696 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4pg4j" event={"ID":"6343bd03-9ff5-42a1-b34c-7492789d08fa","Type":"ContainerStarted","Data":"de14c1516925f8abd61ac665c7984a3a02f875934107eb2582f7a64e07bb580d"} Jul 08 12:01:42.195928 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:42.195490 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" event={"ID":"765f7888-b7ce-445c-bae9-4ab60f3f55f9","Type":"ContainerStarted","Data":"e1f2f3bf3a972115f262df5c1112bd006b7b96968b0dab0efb915658170698de"} Jul 08 12:01:42.197238 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:42.197215 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v8bfs" event={"ID":"b0da5445-6313-44dc-b5e2-602b2eac0a0f","Type":"ContainerStarted","Data":"022e138762cc34c60dac52a38e13b7808753f52586dbf199c2917ab9c56306ff"} Jul 08 12:01:42.199099 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:42.199072 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2f2k6" event={"ID":"bade0a1b-cb4c-4c2b-97dd-1d2844722dfb","Type":"ContainerStarted","Data":"8f51fd16c333a7ffa14abf3b0c72f320fd6ef9d07ecff4bfff5811e64ab084f6"} Jul 08 12:01:42.200610 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:42.200581 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" event={"ID":"91a2b72a6955c737e69b5bf0a1ef3214","Type":"ContainerStarted","Data":"aacf991fad384e2209480d2211860b9dc5637e60d5bb4090fb68033f457f94be"} Jul 08 12:01:42.211242 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:42.211174 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sfqvq" podStartSLOduration=2.639525903 podStartE2EDuration="13.211159107s" totalImagesPullingTime="10.571633204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 12:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:01:42.210838794 +0000 UTC m=+13.570578106" watchObservedRunningTime="2026-07-08 12:01:42.211159107 +0000 UTC m=+13.570898414" Jul 08 12:01:42.254235 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:42.254180 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2f2k6" podStartSLOduration=2.507514009 podStartE2EDuration="13.254160868s" totalImagesPullingTime="10.746646859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:01:42.231208852 +0000 UTC m=+13.590948160" watchObservedRunningTime="2026-07-08 12:01:42.254160868 +0000 UTC m=+13.613900176" Jul 08 12:01:42.254403 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:42.254346 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7tfjf" podStartSLOduration=2.639759121 podStartE2EDuration="13.254340638s" totalImagesPullingTime="10.614581517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 12:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:01:42.253596913 +0000 UTC m=+13.613336221" watchObservedRunningTime="2026-07-08 12:01:42.254340638 +0000 UTC m=+13.614079944" Jul 08 12:01:42.336944 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:42.336877 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v8bfs" podStartSLOduration=2.683718726 podStartE2EDuration="13.336853766s" totalImagesPullingTime="10.65313504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 12:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:01:42.336022364 +0000 UTC m=+13.695761676" watchObservedRunningTime="2026-07-08 12:01:42.336853766 +0000 UTC m=+13.696593072" Jul 08 12:01:43.127217 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:43.127186 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:43.127684 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:43.127333 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:01:43.204893 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:43.204857 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xdd7f" event={"ID":"63336d03-983e-4d0c-909d-670fade0e3b4","Type":"ContainerStarted","Data":"69bb995afe4e7b0ffaed8b9182a29c8c1f910cb254150f8490aa123c6d3f37f2"} Jul 08 12:01:43.222431 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:43.222367 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xdd7f" podStartSLOduration=3.887467077 podStartE2EDuration="14.222345818s" totalImagesPullingTime="10.334878741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 12:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:01:43.222219282 +0000 UTC m=+14.581958590" watchObservedRunningTime="2026-07-08 12:01:43.222345818 +0000 UTC m=+14.582085121" Jul 08 12:01:43.335439 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:43.335404 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2f2k6" Jul 08 12:01:43.336247 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:43.336228 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2f2k6" Jul 08 12:01:44.126536 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:44.126496 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:44.126722 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:44.126515 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:44.126722 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:44.126644 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6htjr" podUID="7796cb1f-125d-4404-9bb3-bb8bb21fa848" Jul 08 12:01:44.126809 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:44.126790 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59z9m" podUID="32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75" Jul 08 12:01:45.127184 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:45.127147 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:45.127620 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:45.127332 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:01:45.209633 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:45.209608 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 12:01:45.974900 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:45.974813 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret\") pod \"global-pull-secret-syncer-6htjr\" (UID: \"7796cb1f-125d-4404-9bb3-bb8bb21fa848\") " pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:45.974900 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:45.974852 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs\") pod \"network-metrics-daemon-hpnpx\" (UID: \"129e9e1b-586a-4226-be04-0544c26f0d9d\") " pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:45.975129 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:45.974989 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 12:01:45.975129 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:45.975035 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 12:01:45.975129 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:45.975066 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret podName:7796cb1f-125d-4404-9bb3-bb8bb21fa848 nodeName:}" failed. No retries permitted until 2026-07-08 12:02:01.975045516 +0000 UTC m=+33.334784803 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret") pod "global-pull-secret-syncer-6htjr" (UID: "7796cb1f-125d-4404-9bb3-bb8bb21fa848") : object "kube-system"/"original-pull-secret" not registered Jul 08 12:01:45.975129 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:45.975082 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs podName:129e9e1b-586a-4226-be04-0544c26f0d9d nodeName:}" failed. No retries permitted until 2026-07-08 12:02:01.975074949 +0000 UTC m=+33.334814234 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs") pod "network-metrics-daemon-hpnpx" (UID: "129e9e1b-586a-4226-be04-0544c26f0d9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 12:01:46.075643 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:46.075610 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phvz6\" (UniqueName: \"kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6\") pod \"network-check-target-59z9m\" (UID: \"32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75\") " pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:46.075814 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:46.075768 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 12:01:46.075814 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:46.075791 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 12:01:46.075814 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:46.075803 2560 projected.go:196] Error preparing data for projected volume kube-api-access-phvz6 for pod openshift-network-diagnostics/network-check-target-59z9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 12:01:46.075996 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:46.075865 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6 podName:32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75 nodeName:}" failed. No retries permitted until 2026-07-08 12:02:02.075846968 +0000 UTC m=+33.435586256 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-phvz6" (UniqueName: "kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6") pod "network-check-target-59z9m" (UID: "32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 12:01:46.127090 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:46.127055 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:46.127241 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:46.127188 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6htjr" podUID="7796cb1f-125d-4404-9bb3-bb8bb21fa848" Jul 08 12:01:46.127557 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:46.127493 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:46.127616 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:46.127590 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59z9m" podUID="32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75" Jul 08 12:01:46.213681 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:46.213644 2560 generic.go:356] "Generic (PLEG): container finished" podID="6343bd03-9ff5-42a1-b34c-7492789d08fa" containerID="de14c1516925f8abd61ac665c7984a3a02f875934107eb2582f7a64e07bb580d" exitCode=0 Jul 08 12:01:46.213855 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:46.213753 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4pg4j" event={"ID":"6343bd03-9ff5-42a1-b34c-7492789d08fa","Type":"ContainerDied","Data":"de14c1516925f8abd61ac665c7984a3a02f875934107eb2582f7a64e07bb580d"} Jul 08 12:01:46.215697 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:46.215669 2560 generic.go:356] "Generic (PLEG): container finished" podID="91a2b72a6955c737e69b5bf0a1ef3214" containerID="aacf991fad384e2209480d2211860b9dc5637e60d5bb4090fb68033f457f94be" exitCode=0 Jul 08 12:01:46.215830 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:46.215719 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" event={"ID":"91a2b72a6955c737e69b5bf0a1ef3214","Type":"ContainerDied","Data":"aacf991fad384e2209480d2211860b9dc5637e60d5bb4090fb68033f457f94be"} Jul 08 12:01:47.127344 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:47.127303 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:47.127839 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:47.127433 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:01:48.127215 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:48.127181 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:48.127387 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:48.127192 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:48.127387 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:48.127312 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6htjr" podUID="7796cb1f-125d-4404-9bb3-bb8bb21fa848" Jul 08 12:01:48.127387 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:48.127359 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59z9m" podUID="32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75" Jul 08 12:01:49.127745 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:49.127716 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:49.128177 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:49.127834 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:01:50.126351 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:50.126318 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:50.126520 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:50.126365 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:50.126520 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:50.126427 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6htjr" podUID="7796cb1f-125d-4404-9bb3-bb8bb21fa848" Jul 08 12:01:50.126520 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:50.126489 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59z9m" podUID="32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75" Jul 08 12:01:50.754006 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:50.753702 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 12:01:51.126900 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:51.126862 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:51.127087 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:51.127029 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:01:51.149744 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:51.149634 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T12:01:50.75394847Z","UUID":"f7f5251d-5f48-49a0-b96f-09c6d0b489ec","Handler":null,"Name":"","Endpoint":""} Jul 08 12:01:51.151715 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:51.151691 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 12:01:51.151879 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:51.151735 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 12:01:51.226855 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:51.226814 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nmgkq" event={"ID":"1214a19e-f428-485c-90c9-0c21901e40a3","Type":"ContainerStarted","Data":"b1ad55c0a0ceb8a3c4f300e3c9d81261ea59cdfe78e7b569e35c3e8d00fbd725"} Jul 08 12:01:51.228790 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:51.228762 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" event={"ID":"00128989-fa63-42fc-82a6-dca1030bf2f5","Type":"ContainerStarted","Data":"aa0d61fd0e098f7007f1fd536b3132df63a334f4f4b43d80fd2efbeca02b707d"} Jul 08 12:01:51.231984 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:51.231952 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" event={"ID":"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5","Type":"ContainerStarted","Data":"81ef521db054bc3fad36662469bfbbf9ad867f91b3f773a27d2f5ea12927e081"} Jul 08 12:01:51.232102 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:51.232014 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" event={"ID":"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5","Type":"ContainerStarted","Data":"1e6d13f4f622d28403f48cc2d3e1c537fab56a528f640575b186c0dd04fe2527"} Jul 08 12:01:51.232102 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:51.232044 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" event={"ID":"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5","Type":"ContainerStarted","Data":"60830b139b9aa5f3a4161ec1bc01a1e459f19a3f813ecae31d85c166660f4e8e"} Jul 08 12:01:51.232102 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:51.232082 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" event={"ID":"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5","Type":"ContainerStarted","Data":"76a087770f54c71e7540498371632b298b6dffbf77359be927107a82f2a9ef23"} Jul 08 12:01:51.232225 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:51.232114 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" event={"ID":"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5","Type":"ContainerStarted","Data":"eab95ee5ac4bf6b95a3dc9826973faadfb52728c0951cdfaf48816095ca3b650"} Jul 08 12:01:51.234143 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:51.234119 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" event={"ID":"91a2b72a6955c737e69b5bf0a1ef3214","Type":"ContainerStarted","Data":"8d82087d1ab2a70ec46d77e31906f77f5fe23604840b685713c774d1e3286bd9"} Jul 08 12:01:51.264334 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:51.264225 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nmgkq" podStartSLOduration=2.749655366 podStartE2EDuration="22.264212008s" totalImagesPullingTime="19.514556642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 12:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:01:51.264097101 +0000 UTC m=+22.623836410" watchObservedRunningTime="2026-07-08 12:01:51.264212008 +0000 UTC m=+22.623951315" Jul 08 12:01:51.279784 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:51.279734 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-232.ec2.internal" podStartSLOduration=21.279718564 podStartE2EDuration="21.279718564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 12:01:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:01:51.27930273 +0000 UTC m=+22.639042038" watchObservedRunningTime="2026-07-08 12:01:51.279718564 +0000 UTC m=+22.639457872" Jul 08 12:01:52.127153 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:52.127085 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:52.127520 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:52.127085 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:52.127520 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:52.127193 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59z9m" podUID="32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75" Jul 08 12:01:52.127520 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:52.127277 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6htjr" podUID="7796cb1f-125d-4404-9bb3-bb8bb21fa848" Jul 08 12:01:52.239625 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:52.239377 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" event={"ID":"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5","Type":"ContainerStarted","Data":"f4763cf47b4da54aea7b8eec23dac7de70cbc4f7bc8dbdee11417bfa96509021"} Jul 08 12:01:52.240707 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:52.240681 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal" event={"ID":"fee1293dc92637ea42dbdc8f05630726","Type":"ContainerStarted","Data":"52e9f22f2c080120257da5f3b0432b0b6c1c88df41a3f9a4c46c4382fbacfeed"} Jul 08 12:01:52.255450 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:52.255403 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-232.ec2.internal" podStartSLOduration=22.255389915 podStartE2EDuration="22.255389915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 12:01:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:01:52.255326678 +0000 UTC m=+23.615065986" watchObservedRunningTime="2026-07-08 12:01:52.255389915 +0000 UTC m=+23.615129221" Jul 08 12:01:53.126713 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:53.126673 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:53.127069 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:53.126785 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:01:53.245900 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:53.245854 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" event={"ID":"00128989-fa63-42fc-82a6-dca1030bf2f5","Type":"ContainerStarted","Data":"af576256f383afc7d9be12b201529d54cafbba436936490dae30dfe7545196bb"} Jul 08 12:01:54.126613 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:54.126584 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:54.126744 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:54.126692 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6htjr" podUID="7796cb1f-125d-4404-9bb3-bb8bb21fa848" Jul 08 12:01:54.126832 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:54.126753 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:54.126873 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:54.126840 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59z9m" podUID="32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75" Jul 08 12:01:54.251132 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:54.251043 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" event={"ID":"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5","Type":"ContainerStarted","Data":"c7c591c0c8177b72e010fa7bbd8abcefb1eb0a43d3accebaf8ffb732a910922a"} Jul 08 12:01:55.127385 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:55.127353 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:55.127555 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:55.127482 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:01:55.283776 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:55.283740 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2f2k6" Jul 08 12:01:55.284304 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:55.283973 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 12:01:55.284415 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:55.284401 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2f2k6" Jul 08 12:01:55.300397 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:55.300350 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r5gvr" podStartSLOduration=5.859458591 podStartE2EDuration="26.300335838s" totalImagesPullingTime="20.440877247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 12:01:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:01:53.265209292 +0000 UTC m=+24.624948600" watchObservedRunningTime="2026-07-08 12:01:55.300335838 +0000 UTC m=+26.660075145" Jul 08 12:01:56.126683 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:56.126657 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:56.126819 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:56.126779 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6htjr" podUID="7796cb1f-125d-4404-9bb3-bb8bb21fa848" Jul 08 12:01:56.126819 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:56.126813 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:56.126945 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:56.126924 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59z9m" podUID="32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75" Jul 08 12:01:56.258161 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:56.258130 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" event={"ID":"ed4bc322-5a8c-49dd-9897-0ec0fa8f2ef5","Type":"ContainerStarted","Data":"d511b45b4df30aca8a85fdc9f3e658e21fdd9138f78d4c49f3ff33b99df27fc6"} Jul 08 12:01:56.288646 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:56.288440 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" podStartSLOduration=7.765889975 podStartE2EDuration="27.288424848s" totalImagesPullingTime="19.522534873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 12:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:01:56.288003169 +0000 UTC m=+27.647742477" watchObservedRunningTime="2026-07-08 12:01:56.288424848 +0000 UTC m=+27.648164154" Jul 08 12:01:57.127065 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:57.127031 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:57.127234 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:57.127192 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:01:57.260552 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:57.260519 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:57.260733 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:57.260605 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:57.260733 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:57.260655 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:57.279175 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:57.278896 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:57.279175 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:57.279068 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:01:58.126687 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:58.126653 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:58.127233 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:58.126652 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:58.127233 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:58.126772 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6htjr" podUID="7796cb1f-125d-4404-9bb3-bb8bb21fa848" Jul 08 12:01:58.127233 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:58.126879 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59z9m" podUID="32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75" Jul 08 12:01:59.083977 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:59.083828 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6htjr"] Jul 08 12:01:59.083977 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:59.083956 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:01:59.084148 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:59.084071 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6htjr" podUID="7796cb1f-125d-4404-9bb3-bb8bb21fa848" Jul 08 12:01:59.086165 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:59.086139 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-59z9m"] Jul 08 12:01:59.086331 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:59.086225 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:01:59.086331 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:59.086299 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59z9m" podUID="32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75" Jul 08 12:01:59.089201 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:59.089178 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hpnpx"] Jul 08 12:01:59.089304 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:01:59.089288 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:01:59.089443 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:01:59.089393 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:02:00.268456 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:00.268425 2560 generic.go:356] "Generic (PLEG): container finished" podID="6343bd03-9ff5-42a1-b34c-7492789d08fa" containerID="0b22c40a61b22753dd0517223b1f54df665d2958f1d5d228d0bb945c4dd699a0" exitCode=0 Jul 08 12:02:00.268797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:00.268466 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4pg4j" event={"ID":"6343bd03-9ff5-42a1-b34c-7492789d08fa","Type":"ContainerDied","Data":"0b22c40a61b22753dd0517223b1f54df665d2958f1d5d228d0bb945c4dd699a0"} Jul 08 12:02:01.126655 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:01.126620 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:02:01.126800 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:01.126727 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:02:01.126800 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:01.126745 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:02:01.126946 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:01.126803 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6htjr" podUID="7796cb1f-125d-4404-9bb3-bb8bb21fa848" Jul 08 12:02:01.126946 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:01.126833 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:02:01.127059 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:01.126987 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59z9m" podUID="32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75" Jul 08 12:02:01.995042 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:01.994999 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret\") pod \"global-pull-secret-syncer-6htjr\" (UID: \"7796cb1f-125d-4404-9bb3-bb8bb21fa848\") " pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:02:01.995042 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:01.995047 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs\") pod \"network-metrics-daemon-hpnpx\" (UID: \"129e9e1b-586a-4226-be04-0544c26f0d9d\") " pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:02:01.995439 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:01.995155 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 12:02:01.995439 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:01.995215 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs podName:129e9e1b-586a-4226-be04-0544c26f0d9d nodeName:}" failed. No retries permitted until 2026-07-08 12:02:33.995199624 +0000 UTC m=+65.354938909 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs") pod "network-metrics-daemon-hpnpx" (UID: "129e9e1b-586a-4226-be04-0544c26f0d9d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 12:02:01.995439 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:01.995154 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 12:02:01.995439 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:01.995253 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret podName:7796cb1f-125d-4404-9bb3-bb8bb21fa848 nodeName:}" failed. No retries permitted until 2026-07-08 12:02:33.995244212 +0000 UTC m=+65.354983498 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret") pod "global-pull-secret-syncer-6htjr" (UID: "7796cb1f-125d-4404-9bb3-bb8bb21fa848") : object "kube-system"/"original-pull-secret" not registered Jul 08 12:02:02.095682 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:02.095645 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phvz6\" (UniqueName: \"kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6\") pod \"network-check-target-59z9m\" (UID: \"32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75\") " pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:02:02.095826 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:02.095802 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 12:02:02.095826 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:02.095824 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 12:02:02.095906 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:02.095835 2560 projected.go:196] Error preparing data for projected volume kube-api-access-phvz6 for pod openshift-network-diagnostics/network-check-target-59z9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 12:02:02.095906 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:02.095884 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6 podName:32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75 nodeName:}" failed. No retries permitted until 2026-07-08 12:02:34.095872022 +0000 UTC m=+65.455611307 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-phvz6" (UniqueName: "kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6") pod "network-check-target-59z9m" (UID: "32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 12:02:03.127006 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.126973 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:02:03.127456 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.126987 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:02:03.127456 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:03.127085 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59z9m" podUID="32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75" Jul 08 12:02:03.127456 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.126987 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:02:03.127456 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:03.127164 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6htjr" podUID="7796cb1f-125d-4404-9bb3-bb8bb21fa848" Jul 08 12:02:03.127456 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:03.127231 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:02:03.441552 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.441519 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-232.ec2.internal" event="NodeReady" Jul 08 12:02:03.441838 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.441660 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 12:02:03.483203 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.482024 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f95f45b8f-5qdqk"] Jul 08 12:02:03.500718 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.500689 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f95f45b8f-5qdqk"] Jul 08 12:02:03.500718 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.500724 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vcls6"] Jul 08 12:02:03.500980 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.500829 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.503424 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.503398 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 12:02:03.503574 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.503460 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j8q6l\"" Jul 08 12:02:03.503574 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.503486 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 12:02:03.503668 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.503662 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 12:02:03.509404 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.509381 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 12:02:03.514821 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.514790 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kt79l"] Jul 08 12:02:03.515313 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.515292 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vcls6" Jul 08 12:02:03.517811 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.517791 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5pzr4\"" Jul 08 12:02:03.517811 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.517803 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 12:02:03.518182 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.518162 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 12:02:03.532878 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.532861 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kt79l" Jul 08 12:02:03.532974 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.532863 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kt79l"] Jul 08 12:02:03.532974 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.532937 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vcls6"] Jul 08 12:02:03.535328 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.535309 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-twvk9\"" Jul 08 12:02:03.535428 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.535311 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 12:02:03.535428 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.535354 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 12:02:03.535428 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.535317 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 12:02:03.605579 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.605551 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khf9b\" (UniqueName: \"kubernetes.io/projected/f4e9612f-d4c4-423f-904a-bd1afb95fa88-kube-api-access-khf9b\") pod \"ingress-canary-kt79l\" (UID: \"f4e9612f-d4c4-423f-904a-bd1afb95fa88\") " pod="openshift-ingress-canary/ingress-canary-kt79l" Jul 08 12:02:03.605579 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.605582 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-bound-sa-token\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.605772 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.605609 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-image-registry-private-configuration\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.605772 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.605627 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-certificates\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.605772 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.605645 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-installation-pull-secrets\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.605772 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.605666 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q4vt\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-kube-api-access-4q4vt\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.605772 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.605685 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-tmp-dir\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:02:03.605772 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.605700 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5xn9\" (UniqueName: \"kubernetes.io/projected/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-kube-api-access-d5xn9\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:02:03.605772 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.605722 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-trusted-ca\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.605772 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.605747 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4e9612f-d4c4-423f-904a-bd1afb95fa88-cert\") pod \"ingress-canary-kt79l\" (UID: \"f4e9612f-d4c4-423f-904a-bd1afb95fa88\") " pod="openshift-ingress-canary/ingress-canary-kt79l" Jul 08 12:02:03.606041 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.605789 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:02:03.606041 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.605804 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.606041 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.605826 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-config-volume\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:02:03.606041 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.605844 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-ca-trust-extracted\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.672865 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.672818 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:03.706750 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.706675 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-trusted-ca\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.706750 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.706712 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4e9612f-d4c4-423f-904a-bd1afb95fa88-cert\") pod \"ingress-canary-kt79l\" (UID: \"f4e9612f-d4c4-423f-904a-bd1afb95fa88\") " pod="openshift-ingress-canary/ingress-canary-kt79l" Jul 08 12:02:03.707033 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.706754 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:02:03.707033 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.706771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.707033 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.706787 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-config-volume\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:02:03.707033 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.706806 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-ca-trust-extracted\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.707033 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.706840 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khf9b\" (UniqueName: \"kubernetes.io/projected/f4e9612f-d4c4-423f-904a-bd1afb95fa88-kube-api-access-khf9b\") pod \"ingress-canary-kt79l\" (UID: \"f4e9612f-d4c4-423f-904a-bd1afb95fa88\") " pod="openshift-ingress-canary/ingress-canary-kt79l" Jul 08 12:02:03.707033 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.706867 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-bound-sa-token\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.707033 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:03.706903 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 12:02:03.707033 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:03.706992 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls podName:785fe3cf-57e7-4673-b7a8-8e40ec6d68bf nodeName:}" failed. No retries permitted until 2026-07-08 12:02:04.206972115 +0000 UTC m=+35.566711402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls") pod "dns-default-vcls6" (UID: "785fe3cf-57e7-4673-b7a8-8e40ec6d68bf") : secret "dns-default-metrics-tls" not found Jul 08 12:02:03.707441 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:03.706925 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 12:02:03.707441 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:03.707076 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f95f45b8f-5qdqk: secret "image-registry-tls" not found Jul 08 12:02:03.707441 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.706906 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-image-registry-private-configuration\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.707441 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:03.707132 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls podName:ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c nodeName:}" failed. No retries permitted until 2026-07-08 12:02:04.207116818 +0000 UTC m=+35.566856103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls") pod "image-registry-6f95f45b8f-5qdqk" (UID: "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c") : secret "image-registry-tls" not found Jul 08 12:02:03.707441 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.707167 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-certificates\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.707441 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.707188 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-installation-pull-secrets\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.707441 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.707208 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q4vt\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-kube-api-access-4q4vt\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.707441 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.707230 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-tmp-dir\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:02:03.707441 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.707250 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5xn9\" (UniqueName: \"kubernetes.io/projected/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-kube-api-access-d5xn9\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:02:03.707981 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.707520 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-config-volume\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:02:03.707981 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.707542 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-ca-trust-extracted\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.707981 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.707761 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-tmp-dir\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:02:03.707981 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.707821 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-trusted-ca\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.708112 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.708044 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-certificates\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.711280 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.711250 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-image-registry-private-configuration\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.711404 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.711297 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-installation-pull-secrets\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.711404 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.711360 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4e9612f-d4c4-423f-904a-bd1afb95fa88-cert\") pod \"ingress-canary-kt79l\" (UID: \"f4e9612f-d4c4-423f-904a-bd1afb95fa88\") " pod="openshift-ingress-canary/ingress-canary-kt79l" Jul 08 12:02:03.719114 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.719088 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-bound-sa-token\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.719243 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.719176 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5xn9\" (UniqueName: \"kubernetes.io/projected/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-kube-api-access-d5xn9\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:02:03.719457 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.719440 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q4vt\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-kube-api-access-4q4vt\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:03.719717 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.719697 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khf9b\" (UniqueName: \"kubernetes.io/projected/f4e9612f-d4c4-423f-904a-bd1afb95fa88-kube-api-access-khf9b\") pod \"ingress-canary-kt79l\" (UID: \"f4e9612f-d4c4-423f-904a-bd1afb95fa88\") " pod="openshift-ingress-canary/ingress-canary-kt79l" Jul 08 12:02:03.772801 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.772773 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:03.840868 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:03.840832 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kt79l" Jul 08 12:02:04.018467 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:04.018437 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kt79l"] Jul 08 12:02:04.034113 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:02:04.034087 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e9612f_d4c4_423f_904a_bd1afb95fa88.slice/crio-fc1129f5082156579a43597eacb07a01f61495f9cbf60f5748e66ee1c1f4be02 WatchSource:0}: Error finding container fc1129f5082156579a43597eacb07a01f61495f9cbf60f5748e66ee1c1f4be02: Status 404 returned error can't find the container with id fc1129f5082156579a43597eacb07a01f61495f9cbf60f5748e66ee1c1f4be02 Jul 08 12:02:04.210979 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:04.210765 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:02:04.211634 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:04.210992 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:04.211634 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:04.210931 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 12:02:04.211634 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:04.211095 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls podName:785fe3cf-57e7-4673-b7a8-8e40ec6d68bf nodeName:}" failed. No retries permitted until 2026-07-08 12:02:05.211079155 +0000 UTC m=+36.570818439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls") pod "dns-default-vcls6" (UID: "785fe3cf-57e7-4673-b7a8-8e40ec6d68bf") : secret "dns-default-metrics-tls" not found Jul 08 12:02:04.211634 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:04.211142 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 12:02:04.211634 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:04.211153 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f95f45b8f-5qdqk: secret "image-registry-tls" not found Jul 08 12:02:04.211634 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:04.211197 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls podName:ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c nodeName:}" failed. No retries permitted until 2026-07-08 12:02:05.211185791 +0000 UTC m=+36.570925076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls") pod "image-registry-6f95f45b8f-5qdqk" (UID: "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c") : secret "image-registry-tls" not found Jul 08 12:02:04.278975 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:04.278939 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kt79l" event={"ID":"f4e9612f-d4c4-423f-904a-bd1afb95fa88","Type":"ContainerStarted","Data":"fc1129f5082156579a43597eacb07a01f61495f9cbf60f5748e66ee1c1f4be02"} Jul 08 12:02:04.280791 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:04.280769 2560 generic.go:356] "Generic (PLEG): container finished" podID="6343bd03-9ff5-42a1-b34c-7492789d08fa" containerID="2fb2f8dcb8c0246dbfb66070a751fe1f4865ab94092fcb62a28cf61841131cdc" exitCode=0 Jul 08 12:02:04.280895 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:04.280803 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4pg4j" event={"ID":"6343bd03-9ff5-42a1-b34c-7492789d08fa","Type":"ContainerDied","Data":"2fb2f8dcb8c0246dbfb66070a751fe1f4865ab94092fcb62a28cf61841131cdc"} Jul 08 12:02:05.127206 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:05.127172 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:02:05.127362 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:05.127172 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:02:05.127407 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:05.127356 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:02:05.130617 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:05.130599 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 12:02:05.131657 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:05.131642 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hvrx5\"" Jul 08 12:02:05.131990 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:05.131967 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 12:02:05.132101 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:05.131990 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 12:02:05.132101 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:05.131976 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 12:02:05.132101 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:05.132069 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rdkjt\"" Jul 08 12:02:05.217771 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:05.217737 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:02:05.218237 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:05.217798 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:05.218237 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:05.217946 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 12:02:05.218237 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:05.217966 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 12:02:05.218237 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:05.217980 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f95f45b8f-5qdqk: secret "image-registry-tls" not found Jul 08 12:02:05.218237 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:05.218021 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls podName:785fe3cf-57e7-4673-b7a8-8e40ec6d68bf nodeName:}" failed. No retries permitted until 2026-07-08 12:02:07.217999276 +0000 UTC m=+38.577738580 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls") pod "dns-default-vcls6" (UID: "785fe3cf-57e7-4673-b7a8-8e40ec6d68bf") : secret "dns-default-metrics-tls" not found Jul 08 12:02:05.218237 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:05.218042 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls podName:ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c nodeName:}" failed. No retries permitted until 2026-07-08 12:02:07.218032628 +0000 UTC m=+38.577771920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls") pod "image-registry-6f95f45b8f-5qdqk" (UID: "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c") : secret "image-registry-tls" not found Jul 08 12:02:05.981036 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:05.980953 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:06.045342 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:06.045310 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:06.289503 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:06.289470 2560 generic.go:356] "Generic (PLEG): container finished" podID="6343bd03-9ff5-42a1-b34c-7492789d08fa" containerID="70a81063cc162a746a4c580185f658914890fa6f37eea60c602b0e719ad2580f" exitCode=0 Jul 08 12:02:06.289969 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:06.289538 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4pg4j" event={"ID":"6343bd03-9ff5-42a1-b34c-7492789d08fa","Type":"ContainerDied","Data":"70a81063cc162a746a4c580185f658914890fa6f37eea60c602b0e719ad2580f"} Jul 08 12:02:07.232949 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:07.232898 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:02:07.232949 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:07.232954 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:07.233172 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:07.233019 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 12:02:07.233172 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:07.233067 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 12:02:07.233172 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:07.233077 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f95f45b8f-5qdqk: secret "image-registry-tls" not found Jul 08 12:02:07.233172 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:07.233085 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls podName:785fe3cf-57e7-4673-b7a8-8e40ec6d68bf nodeName:}" failed. No retries permitted until 2026-07-08 12:02:11.233068907 +0000 UTC m=+42.592808195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls") pod "dns-default-vcls6" (UID: "785fe3cf-57e7-4673-b7a8-8e40ec6d68bf") : secret "dns-default-metrics-tls" not found Jul 08 12:02:07.233172 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:07.233112 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls podName:ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c nodeName:}" failed. No retries permitted until 2026-07-08 12:02:11.233101727 +0000 UTC m=+42.592841012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls") pod "image-registry-6f95f45b8f-5qdqk" (UID: "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c") : secret "image-registry-tls" not found Jul 08 12:02:07.920588 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:07.920552 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:08.161214 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:08.161177 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:08.227841 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:08.227760 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:08.295760 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:08.295724 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kt79l" event={"ID":"f4e9612f-d4c4-423f-904a-bd1afb95fa88","Type":"ContainerStarted","Data":"19ace3cbb228b993d4f3fad9a0261f2fada1aa1d805a018e2e5d722ad7ec82c1"} Jul 08 12:02:08.322099 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:08.322046 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kt79l" podStartSLOduration=2.021052787 podStartE2EDuration="5.32202893s" totalImagesPullingTime="3.300976143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:02:08.321122544 +0000 UTC m=+39.680861852" watchObservedRunningTime="2026-07-08 12:02:08.32202893 +0000 UTC m=+39.681768241" Jul 08 12:02:08.341631 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:08.341594 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:08.425163 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:08.425130 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:08.522957 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:08.522925 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:08.587846 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:08.587809 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:09.130552 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:09.130519 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:09.228927 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:09.228874 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:09.564430 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:09.564395 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:09.633707 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:09.633669 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:11.263361 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:11.263328 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:02:11.263361 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:11.263366 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:11.263791 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:11.263496 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 12:02:11.263791 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:11.263554 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls podName:785fe3cf-57e7-4673-b7a8-8e40ec6d68bf nodeName:}" failed. No retries permitted until 2026-07-08 12:02:19.263540649 +0000 UTC m=+50.623279933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls") pod "dns-default-vcls6" (UID: "785fe3cf-57e7-4673-b7a8-8e40ec6d68bf") : secret "dns-default-metrics-tls" not found Jul 08 12:02:11.263791 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:11.263501 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 12:02:11.263791 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:11.263596 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f95f45b8f-5qdqk: secret "image-registry-tls" not found Jul 08 12:02:11.263791 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:11.263636 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls podName:ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c nodeName:}" failed. No retries permitted until 2026-07-08 12:02:19.263625503 +0000 UTC m=+50.623364788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls") pod "image-registry-6f95f45b8f-5qdqk" (UID: "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c") : secret "image-registry-tls" not found Jul 08 12:02:13.103420 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:13.103381 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:13.205064 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:13.205025 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:14.313704 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:14.313511 2560 generic.go:356] "Generic (PLEG): container finished" podID="6343bd03-9ff5-42a1-b34c-7492789d08fa" containerID="f8740caf8e9aff75291e1ca3ef28564c8e662c0791fa73043130ebb8514f272d" exitCode=0 Jul 08 12:02:14.313704 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:14.313585 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4pg4j" event={"ID":"6343bd03-9ff5-42a1-b34c-7492789d08fa","Type":"ContainerDied","Data":"f8740caf8e9aff75291e1ca3ef28564c8e662c0791fa73043130ebb8514f272d"} Jul 08 12:02:15.319173 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:15.319140 2560 generic.go:356] "Generic (PLEG): container finished" podID="6343bd03-9ff5-42a1-b34c-7492789d08fa" containerID="ea516eb0c3375acdf9896931a7cbd9d85133d491fb396fa3d29a6a2e9d9eeeaf" exitCode=0 Jul 08 12:02:15.319534 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:15.319204 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4pg4j" event={"ID":"6343bd03-9ff5-42a1-b34c-7492789d08fa","Type":"ContainerDied","Data":"ea516eb0c3375acdf9896931a7cbd9d85133d491fb396fa3d29a6a2e9d9eeeaf"} Jul 08 12:02:15.494612 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:15.494584 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:15.599112 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:15.599030 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:16.325010 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:16.324974 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4pg4j" event={"ID":"6343bd03-9ff5-42a1-b34c-7492789d08fa","Type":"ContainerStarted","Data":"051cfc5b726f39ee2528af366841fec89673f431ff586055eff004f334af0786"} Jul 08 12:02:16.351460 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:16.351408 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4pg4j" podStartSLOduration=11.253463888 podStartE2EDuration="47.351393112s" totalImagesPullingTime="36.097929224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 12:01:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:02:16.350234935 +0000 UTC m=+47.709974241" watchObservedRunningTime="2026-07-08 12:02:16.351393112 +0000 UTC m=+47.711132416" Jul 08 12:02:16.474696 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:16.474640 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:16.578948 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:16.578843 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:19.332501 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:19.332465 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:02:19.332501 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:19.332500 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:19.333019 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:19.332619 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 12:02:19.333019 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:19.332647 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 12:02:19.333019 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:19.332660 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f95f45b8f-5qdqk: secret "image-registry-tls" not found Jul 08 12:02:19.333019 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:19.332696 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls podName:785fe3cf-57e7-4673-b7a8-8e40ec6d68bf nodeName:}" failed. No retries permitted until 2026-07-08 12:02:35.332676942 +0000 UTC m=+66.692416240 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls") pod "dns-default-vcls6" (UID: "785fe3cf-57e7-4673-b7a8-8e40ec6d68bf") : secret "dns-default-metrics-tls" not found Jul 08 12:02:19.333019 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:19.332711 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls podName:ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c nodeName:}" failed. No retries permitted until 2026-07-08 12:02:35.332704625 +0000 UTC m=+66.692443913 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls") pod "image-registry-6f95f45b8f-5qdqk" (UID: "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c") : secret "image-registry-tls" not found Jul 08 12:02:24.311167 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:24.311133 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:29.275717 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:29.275689 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tsxw" Jul 08 12:02:29.440695 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:29.440638 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:29.501419 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:29.501388 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:31.152835 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:31.152796 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:31.252599 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:31.252566 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:32.082824 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:32.082789 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:32.211049 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:32.211011 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:32.315185 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:32.315155 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:32.415521 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:32.415433 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:34.039679 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:34.039644 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret\") pod \"global-pull-secret-syncer-6htjr\" (UID: \"7796cb1f-125d-4404-9bb3-bb8bb21fa848\") " pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:02:34.039679 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:34.039684 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs\") pod \"network-metrics-daemon-hpnpx\" (UID: \"129e9e1b-586a-4226-be04-0544c26f0d9d\") " pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:02:34.042366 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:34.042343 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 12:02:34.042630 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:34.042612 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 12:02:34.050796 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:34.050773 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 12:02:34.050887 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:34.050848 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs podName:129e9e1b-586a-4226-be04-0544c26f0d9d nodeName:}" failed. No retries permitted until 2026-07-08 12:03:38.05082959 +0000 UTC m=+129.410568880 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs") pod "network-metrics-daemon-hpnpx" (UID: "129e9e1b-586a-4226-be04-0544c26f0d9d") : secret "metrics-daemon-secret" not found Jul 08 12:02:34.054543 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:34.054523 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7796cb1f-125d-4404-9bb3-bb8bb21fa848-original-pull-secret\") pod \"global-pull-secret-syncer-6htjr\" (UID: \"7796cb1f-125d-4404-9bb3-bb8bb21fa848\") " pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:02:34.098695 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:34.098655 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:34.140658 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:34.140623 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phvz6\" (UniqueName: \"kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6\") pod \"network-check-target-59z9m\" (UID: \"32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75\") " pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:02:34.143587 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:34.143569 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 12:02:34.154007 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:34.153982 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 12:02:34.162719 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:34.162690 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:34.164066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:34.164049 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phvz6\" (UniqueName: \"kubernetes.io/projected/32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75-kube-api-access-phvz6\") pod \"network-check-target-59z9m\" (UID: \"32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75\") " pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:02:34.237225 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:34.237188 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6htjr" Jul 08 12:02:34.247747 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:34.247726 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hvrx5\"" Jul 08 12:02:34.256060 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:34.256035 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:02:34.392024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:34.391993 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6htjr"] Jul 08 12:02:34.394896 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:02:34.394858 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7796cb1f_125d_4404_9bb3_bb8bb21fa848.slice/crio-b60633b4608ac272c516c86f32fa8fc27c281b47d3b8082b06fe49d51029f8c7 WatchSource:0}: Error finding container b60633b4608ac272c516c86f32fa8fc27c281b47d3b8082b06fe49d51029f8c7: Status 404 returned error can't find the container with id b60633b4608ac272c516c86f32fa8fc27c281b47d3b8082b06fe49d51029f8c7 Jul 08 12:02:34.396826 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:34.396787 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-59z9m"] Jul 08 12:02:34.399038 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:02:34.399018 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32d2ac0d_05dd_46c9_a924_e4d2ff5ddd75.slice/crio-b01d3ae271c93773be8a76bc4e5f4560988e49dce0a21448488df698c5953c29 WatchSource:0}: Error finding container b01d3ae271c93773be8a76bc4e5f4560988e49dce0a21448488df698c5953c29: Status 404 returned error can't find the container with id b01d3ae271c93773be8a76bc4e5f4560988e49dce0a21448488df698c5953c29 Jul 08 12:02:35.351637 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:35.351597 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:02:35.352115 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:35.351644 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:02:35.352115 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:35.351774 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 12:02:35.352115 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:35.351790 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f95f45b8f-5qdqk: secret "image-registry-tls" not found Jul 08 12:02:35.352115 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:35.351841 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls podName:ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c nodeName:}" failed. No retries permitted until 2026-07-08 12:03:07.351824776 +0000 UTC m=+98.711564061 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls") pod "image-registry-6f95f45b8f-5qdqk" (UID: "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c") : secret "image-registry-tls" not found Jul 08 12:02:35.352115 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:35.351774 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 12:02:35.352115 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:02:35.351940 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls podName:785fe3cf-57e7-4673-b7a8-8e40ec6d68bf nodeName:}" failed. No retries permitted until 2026-07-08 12:03:07.351907119 +0000 UTC m=+98.711646408 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls") pod "dns-default-vcls6" (UID: "785fe3cf-57e7-4673-b7a8-8e40ec6d68bf") : secret "dns-default-metrics-tls" not found Jul 08 12:02:35.373784 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:35.373738 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6htjr" event={"ID":"7796cb1f-125d-4404-9bb3-bb8bb21fa848","Type":"ContainerStarted","Data":"b60633b4608ac272c516c86f32fa8fc27c281b47d3b8082b06fe49d51029f8c7"} Jul 08 12:02:35.375223 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:35.375193 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-59z9m" event={"ID":"32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75","Type":"ContainerStarted","Data":"b01d3ae271c93773be8a76bc4e5f4560988e49dce0a21448488df698c5953c29"} Jul 08 12:02:36.110928 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:36.110875 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:37.743807 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:37.743769 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:37.805930 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:37.805890 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:41.392203 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:41.392163 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-59z9m" event={"ID":"32d2ac0d-05dd-46c9-a924-e4d2ff5ddd75","Type":"ContainerStarted","Data":"c142810404fd68295e05199d16b1023b2ead4de8746e935e8714e3defc40b31f"} Jul 08 12:02:41.392636 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:41.392222 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:02:41.393473 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:41.393445 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6htjr" event={"ID":"7796cb1f-125d-4404-9bb3-bb8bb21fa848","Type":"ContainerStarted","Data":"69312a8a50071e59dc08ea09fe6a6a6f23f1a7fbb070d63500b10c8ab3f727a4"} Jul 08 12:02:41.410307 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:41.410265 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-59z9m" podStartSLOduration=66.397921275 podStartE2EDuration="1m12.410251241s" totalImagesPullingTime="6.012329966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:02:41.409032845 +0000 UTC m=+72.768772165" watchObservedRunningTime="2026-07-08 12:02:41.410251241 +0000 UTC m=+72.769990541" Jul 08 12:02:41.424281 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:41.424233 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6htjr" podStartSLOduration=66.409373774 podStartE2EDuration="1m12.424216901s" totalImagesPullingTime="6.014843127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 12:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:02:41.423430103 +0000 UTC m=+72.783169410" watchObservedRunningTime="2026-07-08 12:02:41.424216901 +0000 UTC m=+72.783956208" Jul 08 12:02:43.248834 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:43.248801 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:44.591781 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:44.591744 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:48.247104 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:48.247069 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:48.311840 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:48.311807 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:50.078929 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:50.078858 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:50.180052 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:50.180017 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:50.281160 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:50.281124 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:54.270794 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:54.270733 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:02:54.372877 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:02:54.372835 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:00.093250 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:00.093211 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:00.159981 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:00.159936 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:07.381797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:07.381738 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:03:07.381797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:07.381801 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:03:07.382282 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:07.381887 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 12:03:07.382282 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:07.381962 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 12:03:07.382282 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:07.381975 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls podName:785fe3cf-57e7-4673-b7a8-8e40ec6d68bf nodeName:}" failed. No retries permitted until 2026-07-08 12:04:11.381958984 +0000 UTC m=+162.741698269 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls") pod "dns-default-vcls6" (UID: "785fe3cf-57e7-4673-b7a8-8e40ec6d68bf") : secret "dns-default-metrics-tls" not found Jul 08 12:03:07.382282 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:07.381977 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f95f45b8f-5qdqk: secret "image-registry-tls" not found Jul 08 12:03:07.382282 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:07.382036 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls podName:ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c nodeName:}" failed. No retries permitted until 2026-07-08 12:04:11.382023411 +0000 UTC m=+162.741762695 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls") pod "image-registry-6f95f45b8f-5qdqk" (UID: "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c") : secret "image-registry-tls" not found Jul 08 12:03:09.197126 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:09.197079 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:09.259046 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:09.259017 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:12.398227 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:12.398193 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-59z9m" Jul 08 12:03:23.603701 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.603667 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2"] Jul 08 12:03:23.606356 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.606340 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" Jul 08 12:03:23.608521 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.608498 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-jxw77"] Jul 08 12:03:23.611076 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.611057 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:03:23.619220 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.619200 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 08 12:03:23.620776 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.620757 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 12:03:23.622188 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.622170 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6k64w\"" Jul 08 12:03:23.622188 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.622182 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 08 12:03:23.622489 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.622474 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 08 12:03:23.622635 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.622490 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 12:03:23.622986 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.622974 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-sn2rz\"" Jul 08 12:03:23.623231 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.623219 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 08 12:03:23.630276 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.630259 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 08 12:03:23.630364 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.630278 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 08 12:03:23.649106 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.649072 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2"] Jul 08 12:03:23.656413 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.656386 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-jxw77"] Jul 08 12:03:23.662587 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.662563 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 08 12:03:23.700278 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.700243 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v45jt\" (UniqueName: \"kubernetes.io/projected/b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd-kube-api-access-v45jt\") pod \"console-operator-68b757fb67-jxw77\" (UID: \"b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd\") " pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:03:23.700474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.700369 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd-config\") pod \"console-operator-68b757fb67-jxw77\" (UID: \"b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd\") " pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:03:23.700474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.700413 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4rgw2\" (UID: \"de054497-a501-48d6-9337-823f98895573\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" Jul 08 12:03:23.700474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.700440 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfknx\" (UniqueName: \"kubernetes.io/projected/de054497-a501-48d6-9337-823f98895573-kube-api-access-wfknx\") pod \"cluster-monitoring-operator-64786d9cbb-4rgw2\" (UID: \"de054497-a501-48d6-9337-823f98895573\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" Jul 08 12:03:23.700599 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.700541 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/de054497-a501-48d6-9337-823f98895573-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-4rgw2\" (UID: \"de054497-a501-48d6-9337-823f98895573\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" Jul 08 12:03:23.700599 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.700580 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd-serving-cert\") pod \"console-operator-68b757fb67-jxw77\" (UID: \"b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd\") " pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:03:23.700680 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.700626 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd-trusted-ca\") pod \"console-operator-68b757fb67-jxw77\" (UID: \"b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd\") " pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:03:23.701510 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.701488 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n"] Jul 08 12:03:23.704408 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.704384 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n" Jul 08 12:03:23.707497 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.707477 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 08 12:03:23.707497 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.707494 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 08 12:03:23.707668 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.707538 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zz76c\"" Jul 08 12:03:23.707746 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.707734 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 08 12:03:23.713657 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.713637 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n"] Jul 08 12:03:23.801788 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.801747 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v45jt\" (UniqueName: \"kubernetes.io/projected/b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd-kube-api-access-v45jt\") pod \"console-operator-68b757fb67-jxw77\" (UID: \"b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd\") " pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:03:23.801788 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.801788 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8af93bb-fee4-4a90-ae96-efc184f3541f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-pkd4n\" (UID: \"c8af93bb-fee4-4a90-ae96-efc184f3541f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n" Jul 08 12:03:23.802083 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.801950 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd-config\") pod \"console-operator-68b757fb67-jxw77\" (UID: \"b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd\") " pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:03:23.802083 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.801996 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4rgw2\" (UID: \"de054497-a501-48d6-9337-823f98895573\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" Jul 08 12:03:23.802083 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.802026 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfknx\" (UniqueName: \"kubernetes.io/projected/de054497-a501-48d6-9337-823f98895573-kube-api-access-wfknx\") pod \"cluster-monitoring-operator-64786d9cbb-4rgw2\" (UID: \"de054497-a501-48d6-9337-823f98895573\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" Jul 08 12:03:23.802083 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.802062 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/de054497-a501-48d6-9337-823f98895573-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-4rgw2\" (UID: \"de054497-a501-48d6-9337-823f98895573\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" Jul 08 12:03:23.802278 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.802093 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4cbh\" (UniqueName: \"kubernetes.io/projected/c8af93bb-fee4-4a90-ae96-efc184f3541f-kube-api-access-t4cbh\") pod \"cluster-samples-operator-56fcf86bf-pkd4n\" (UID: \"c8af93bb-fee4-4a90-ae96-efc184f3541f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n" Jul 08 12:03:23.802278 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.802119 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd-serving-cert\") pod \"console-operator-68b757fb67-jxw77\" (UID: \"b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd\") " pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:03:23.802278 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:23.802173 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 12:03:23.802278 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.802183 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd-trusted-ca\") pod \"console-operator-68b757fb67-jxw77\" (UID: \"b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd\") " pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:03:23.802278 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:23.802246 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls podName:de054497-a501-48d6-9337-823f98895573 nodeName:}" failed. No retries permitted until 2026-07-08 12:03:24.302223871 +0000 UTC m=+115.661963157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4rgw2" (UID: "de054497-a501-48d6-9337-823f98895573") : secret "cluster-monitoring-operator-tls" not found Jul 08 12:03:23.802713 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.802677 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd-config\") pod \"console-operator-68b757fb67-jxw77\" (UID: \"b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd\") " pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:03:23.802890 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.802871 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/de054497-a501-48d6-9337-823f98895573-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-4rgw2\" (UID: \"de054497-a501-48d6-9337-823f98895573\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" Jul 08 12:03:23.803027 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.803010 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd-trusted-ca\") pod \"console-operator-68b757fb67-jxw77\" (UID: \"b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd\") " pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:03:23.804417 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.804388 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd-serving-cert\") pod \"console-operator-68b757fb67-jxw77\" (UID: \"b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd\") " pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:03:23.813333 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.813308 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v45jt\" (UniqueName: \"kubernetes.io/projected/b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd-kube-api-access-v45jt\") pod \"console-operator-68b757fb67-jxw77\" (UID: \"b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd\") " pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:03:23.813470 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.813453 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfknx\" (UniqueName: \"kubernetes.io/projected/de054497-a501-48d6-9337-823f98895573-kube-api-access-wfknx\") pod \"cluster-monitoring-operator-64786d9cbb-4rgw2\" (UID: \"de054497-a501-48d6-9337-823f98895573\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" Jul 08 12:03:23.857280 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.857191 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:23.903280 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.903244 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4cbh\" (UniqueName: \"kubernetes.io/projected/c8af93bb-fee4-4a90-ae96-efc184f3541f-kube-api-access-t4cbh\") pod \"cluster-samples-operator-56fcf86bf-pkd4n\" (UID: \"c8af93bb-fee4-4a90-ae96-efc184f3541f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n" Jul 08 12:03:23.903445 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.903314 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8af93bb-fee4-4a90-ae96-efc184f3541f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-pkd4n\" (UID: \"c8af93bb-fee4-4a90-ae96-efc184f3541f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n" Jul 08 12:03:23.903445 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:23.903430 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 12:03:23.903523 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:23.903498 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8af93bb-fee4-4a90-ae96-efc184f3541f-samples-operator-tls podName:c8af93bb-fee4-4a90-ae96-efc184f3541f nodeName:}" failed. No retries permitted until 2026-07-08 12:03:24.403477813 +0000 UTC m=+115.763217098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c8af93bb-fee4-4a90-ae96-efc184f3541f-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-pkd4n" (UID: "c8af93bb-fee4-4a90-ae96-efc184f3541f") : secret "samples-operator-tls" not found Jul 08 12:03:23.912796 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.912767 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4cbh\" (UniqueName: \"kubernetes.io/projected/c8af93bb-fee4-4a90-ae96-efc184f3541f-kube-api-access-t4cbh\") pod \"cluster-samples-operator-56fcf86bf-pkd4n\" (UID: \"c8af93bb-fee4-4a90-ae96-efc184f3541f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n" Jul 08 12:03:23.920679 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.920651 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:03:23.934298 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:23.934267 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:24.047169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:24.047140 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-jxw77"] Jul 08 12:03:24.050101 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:03:24.050077 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb25b26e6_a5e0_46b1_bb84_ea8cf1b193dd.slice/crio-77afde46118e3985e36a769816a994e5a2c0e7bbee2976b9ada20e07b3c0941f WatchSource:0}: Error finding container 77afde46118e3985e36a769816a994e5a2c0e7bbee2976b9ada20e07b3c0941f: Status 404 returned error can't find the container with id 77afde46118e3985e36a769816a994e5a2c0e7bbee2976b9ada20e07b3c0941f Jul 08 12:03:24.307469 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:24.307425 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4rgw2\" (UID: \"de054497-a501-48d6-9337-823f98895573\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" Jul 08 12:03:24.307678 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:24.307574 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 12:03:24.307678 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:24.307650 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls podName:de054497-a501-48d6-9337-823f98895573 nodeName:}" failed. No retries permitted until 2026-07-08 12:03:25.3076342 +0000 UTC m=+116.667373485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4rgw2" (UID: "de054497-a501-48d6-9337-823f98895573") : secret "cluster-monitoring-operator-tls" not found Jul 08 12:03:24.408564 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:24.408526 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8af93bb-fee4-4a90-ae96-efc184f3541f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-pkd4n\" (UID: \"c8af93bb-fee4-4a90-ae96-efc184f3541f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n" Jul 08 12:03:24.408689 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:24.408644 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 12:03:24.408733 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:24.408706 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8af93bb-fee4-4a90-ae96-efc184f3541f-samples-operator-tls podName:c8af93bb-fee4-4a90-ae96-efc184f3541f nodeName:}" failed. No retries permitted until 2026-07-08 12:03:25.408692115 +0000 UTC m=+116.768431401 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c8af93bb-fee4-4a90-ae96-efc184f3541f-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-pkd4n" (UID: "c8af93bb-fee4-4a90-ae96-efc184f3541f") : secret "samples-operator-tls" not found Jul 08 12:03:24.494702 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:24.494667 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" event={"ID":"b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd","Type":"ContainerStarted","Data":"77afde46118e3985e36a769816a994e5a2c0e7bbee2976b9ada20e07b3c0941f"} Jul 08 12:03:25.315380 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:25.315341 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4rgw2\" (UID: \"de054497-a501-48d6-9337-823f98895573\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" Jul 08 12:03:25.315786 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:25.315465 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 12:03:25.315786 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:25.315523 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls podName:de054497-a501-48d6-9337-823f98895573 nodeName:}" failed. No retries permitted until 2026-07-08 12:03:27.315505009 +0000 UTC m=+118.675244294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4rgw2" (UID: "de054497-a501-48d6-9337-823f98895573") : secret "cluster-monitoring-operator-tls" not found Jul 08 12:03:25.416136 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:25.416078 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8af93bb-fee4-4a90-ae96-efc184f3541f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-pkd4n\" (UID: \"c8af93bb-fee4-4a90-ae96-efc184f3541f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n" Jul 08 12:03:25.416309 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:25.416240 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 12:03:25.416309 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:25.416301 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8af93bb-fee4-4a90-ae96-efc184f3541f-samples-operator-tls podName:c8af93bb-fee4-4a90-ae96-efc184f3541f nodeName:}" failed. No retries permitted until 2026-07-08 12:03:27.416287258 +0000 UTC m=+118.776026543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c8af93bb-fee4-4a90-ae96-efc184f3541f-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-pkd4n" (UID: "c8af93bb-fee4-4a90-ae96-efc184f3541f") : secret "samples-operator-tls" not found Jul 08 12:03:26.275589 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:26.275552 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:26.379669 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:26.379634 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:27.330834 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:27.330803 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4rgw2\" (UID: \"de054497-a501-48d6-9337-823f98895573\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" Jul 08 12:03:27.331045 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:27.330982 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 12:03:27.331119 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:27.331049 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls podName:de054497-a501-48d6-9337-823f98895573 nodeName:}" failed. No retries permitted until 2026-07-08 12:03:31.331033865 +0000 UTC m=+122.690773150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4rgw2" (UID: "de054497-a501-48d6-9337-823f98895573") : secret "cluster-monitoring-operator-tls" not found Jul 08 12:03:27.432064 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:27.432028 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8af93bb-fee4-4a90-ae96-efc184f3541f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-pkd4n\" (UID: \"c8af93bb-fee4-4a90-ae96-efc184f3541f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n" Jul 08 12:03:27.432470 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:27.432212 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 12:03:27.432470 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:27.432296 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8af93bb-fee4-4a90-ae96-efc184f3541f-samples-operator-tls podName:c8af93bb-fee4-4a90-ae96-efc184f3541f nodeName:}" failed. No retries permitted until 2026-07-08 12:03:31.432274182 +0000 UTC m=+122.792013474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c8af93bb-fee4-4a90-ae96-efc184f3541f-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-pkd4n" (UID: "c8af93bb-fee4-4a90-ae96-efc184f3541f") : secret "samples-operator-tls" not found Jul 08 12:03:27.685827 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:27.685793 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:27.786995 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:27.786960 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:27.922783 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:27.922698 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:28.029551 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.029519 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:28.079473 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.079438 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fh2b6"] Jul 08 12:03:28.082557 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.082534 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:28.085391 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.085369 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 12:03:28.085498 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.085370 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6nfnf\"" Jul 08 12:03:28.086466 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.086450 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 12:03:28.086516 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.086450 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 12:03:28.086516 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.086476 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 12:03:28.102634 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.102607 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fh2b6"] Jul 08 12:03:28.122579 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.122524 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:28.239675 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.239590 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6c06582-b8ae-43a6-81b4-7366d2012e58-data-volume\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:28.239675 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.239629 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf4wr\" (UniqueName: \"kubernetes.io/projected/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-api-access-kf4wr\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:28.239842 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.239711 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6c06582-b8ae-43a6-81b4-7366d2012e58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:28.239842 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.239767 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6c06582-b8ae-43a6-81b4-7366d2012e58-crio-socket\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:28.239842 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.239799 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:28.340280 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.340245 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6c06582-b8ae-43a6-81b4-7366d2012e58-crio-socket\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:28.340425 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.340285 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:28.340425 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.340324 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6c06582-b8ae-43a6-81b4-7366d2012e58-data-volume\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:28.340425 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.340342 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf4wr\" (UniqueName: \"kubernetes.io/projected/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-api-access-kf4wr\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:28.340425 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.340373 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6c06582-b8ae-43a6-81b4-7366d2012e58-crio-socket\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:28.340425 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.340380 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6c06582-b8ae-43a6-81b4-7366d2012e58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:28.340653 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:28.340471 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 12:03:28.340653 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:28.340473 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 12:03:28.340653 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:28.340522 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6c06582-b8ae-43a6-81b4-7366d2012e58-insights-runtime-extractor-tls podName:c6c06582-b8ae-43a6-81b4-7366d2012e58 nodeName:}" failed. No retries permitted until 2026-07-08 12:03:28.840506794 +0000 UTC m=+120.200246082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6c06582-b8ae-43a6-81b4-7366d2012e58-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fh2b6" (UID: "c6c06582-b8ae-43a6-81b4-7366d2012e58") : secret "insights-runtime-extractor-tls" not found Jul 08 12:03:28.340653 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:28.340535 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-rbac-proxy-cm podName:c6c06582-b8ae-43a6-81b4-7366d2012e58 nodeName:}" failed. No retries permitted until 2026-07-08 12:03:28.840528484 +0000 UTC m=+120.200267769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fh2b6" (UID: "c6c06582-b8ae-43a6-81b4-7366d2012e58") : configmap "kube-rbac-proxy" not found Jul 08 12:03:28.340653 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.340639 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6c06582-b8ae-43a6-81b4-7366d2012e58-data-volume\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:28.355687 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.355656 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf4wr\" (UniqueName: \"kubernetes.io/projected/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-api-access-kf4wr\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:28.383744 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.383714 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:28.505804 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.505736 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/0.log" Jul 08 12:03:28.505804 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.505778 2560 generic.go:356] "Generic (PLEG): container finished" podID="b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd" containerID="360d88c9193281876ba881ca3e433bf69c02e9836c079ae88e7244cc6b216cc2" exitCode=255 Jul 08 12:03:28.506205 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.505809 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" event={"ID":"b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd","Type":"ContainerDied","Data":"360d88c9193281876ba881ca3e433bf69c02e9836c079ae88e7244cc6b216cc2"} Jul 08 12:03:28.506205 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.506055 2560 scope.go:117] "RemoveContainer" containerID="360d88c9193281876ba881ca3e433bf69c02e9836c079ae88e7244cc6b216cc2" Jul 08 12:03:28.844804 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.844762 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6c06582-b8ae-43a6-81b4-7366d2012e58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:28.845081 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:28.844830 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:28.845081 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:28.844906 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 12:03:28.845081 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:28.844936 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 12:03:28.845081 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:28.844975 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-rbac-proxy-cm podName:c6c06582-b8ae-43a6-81b4-7366d2012e58 nodeName:}" failed. No retries permitted until 2026-07-08 12:03:29.844962028 +0000 UTC m=+121.204701312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fh2b6" (UID: "c6c06582-b8ae-43a6-81b4-7366d2012e58") : configmap "kube-rbac-proxy" not found Jul 08 12:03:28.845081 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:28.844996 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6c06582-b8ae-43a6-81b4-7366d2012e58-insights-runtime-extractor-tls podName:c6c06582-b8ae-43a6-81b4-7366d2012e58 nodeName:}" failed. No retries permitted until 2026-07-08 12:03:29.84498109 +0000 UTC m=+121.204720375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6c06582-b8ae-43a6-81b4-7366d2012e58-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fh2b6" (UID: "c6c06582-b8ae-43a6-81b4-7366d2012e58") : secret "insights-runtime-extractor-tls" not found Jul 08 12:03:29.513580 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:29.513552 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/1.log" Jul 08 12:03:29.514063 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:29.513941 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/0.log" Jul 08 12:03:29.514063 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:29.513974 2560 generic.go:356] "Generic (PLEG): container finished" podID="b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd" containerID="0c22d65627394bcdf5eb8fbf3224a4c218286087105f9b3f51ae633d6a5579a2" exitCode=255 Jul 08 12:03:29.514063 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:29.514013 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" event={"ID":"b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd","Type":"ContainerDied","Data":"0c22d65627394bcdf5eb8fbf3224a4c218286087105f9b3f51ae633d6a5579a2"} Jul 08 12:03:29.514235 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:29.514097 2560 scope.go:117] "RemoveContainer" containerID="360d88c9193281876ba881ca3e433bf69c02e9836c079ae88e7244cc6b216cc2" Jul 08 12:03:29.514284 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:29.514252 2560 scope.go:117] "RemoveContainer" containerID="0c22d65627394bcdf5eb8fbf3224a4c218286087105f9b3f51ae633d6a5579a2" Jul 08 12:03:29.514464 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:29.514426 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-jxw77_openshift-console-operator(b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd)\"" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" podUID="b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd" Jul 08 12:03:29.558498 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:29.558438 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:29.628835 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:29.628802 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:29.852130 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:29.852034 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6c06582-b8ae-43a6-81b4-7366d2012e58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:29.852130 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:29.852113 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:29.852320 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:29.852204 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 12:03:29.852320 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:29.852252 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 12:03:29.852320 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:29.852268 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6c06582-b8ae-43a6-81b4-7366d2012e58-insights-runtime-extractor-tls podName:c6c06582-b8ae-43a6-81b4-7366d2012e58 nodeName:}" failed. No retries permitted until 2026-07-08 12:03:31.852252054 +0000 UTC m=+123.211991356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6c06582-b8ae-43a6-81b4-7366d2012e58-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fh2b6" (UID: "c6c06582-b8ae-43a6-81b4-7366d2012e58") : secret "insights-runtime-extractor-tls" not found Jul 08 12:03:29.852320 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:29.852305 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-rbac-proxy-cm podName:c6c06582-b8ae-43a6-81b4-7366d2012e58 nodeName:}" failed. No retries permitted until 2026-07-08 12:03:31.852291807 +0000 UTC m=+123.212031092 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fh2b6" (UID: "c6c06582-b8ae-43a6-81b4-7366d2012e58") : configmap "kube-rbac-proxy" not found Jul 08 12:03:30.035571 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:30.035535 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:30.053304 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:30.053276 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v8bfs_b0da5445-6313-44dc-b5e2-602b2eac0a0f/dns-node-resolver/0.log" Jul 08 12:03:30.517379 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:30.517352 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/1.log" Jul 08 12:03:30.517746 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:30.517664 2560 scope.go:117] "RemoveContainer" containerID="0c22d65627394bcdf5eb8fbf3224a4c218286087105f9b3f51ae633d6a5579a2" Jul 08 12:03:30.517823 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:30.517805 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-jxw77_openshift-console-operator(b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd)\"" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" podUID="b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd" Jul 08 12:03:31.252265 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:31.252239 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sfqvq_e398d007-962f-4661-ad5d-74798f925e45/node-ca/0.log" Jul 08 12:03:31.291282 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:31.291237 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:31.365959 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:31.365894 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4rgw2\" (UID: \"de054497-a501-48d6-9337-823f98895573\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" Jul 08 12:03:31.366110 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:31.366048 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 12:03:31.366151 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:31.366110 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls podName:de054497-a501-48d6-9337-823f98895573 nodeName:}" failed. No retries permitted until 2026-07-08 12:03:39.366094995 +0000 UTC m=+130.725834296 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4rgw2" (UID: "de054497-a501-48d6-9337-823f98895573") : secret "cluster-monitoring-operator-tls" not found Jul 08 12:03:31.466406 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:31.466365 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8af93bb-fee4-4a90-ae96-efc184f3541f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-pkd4n\" (UID: \"c8af93bb-fee4-4a90-ae96-efc184f3541f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n" Jul 08 12:03:31.466540 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:31.466522 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 12:03:31.466601 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:31.466589 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8af93bb-fee4-4a90-ae96-efc184f3541f-samples-operator-tls podName:c8af93bb-fee4-4a90-ae96-efc184f3541f nodeName:}" failed. No retries permitted until 2026-07-08 12:03:39.466572323 +0000 UTC m=+130.826311625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c8af93bb-fee4-4a90-ae96-efc184f3541f-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-pkd4n" (UID: "c8af93bb-fee4-4a90-ae96-efc184f3541f") : secret "samples-operator-tls" not found Jul 08 12:03:31.653883 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:31.653849 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kt79l_f4e9612f-d4c4-423f-904a-bd1afb95fa88/serve-healthcheck-canary/0.log" Jul 08 12:03:31.868767 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:31.868731 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:31.868942 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:31.868815 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6c06582-b8ae-43a6-81b4-7366d2012e58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:31.868942 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:31.868842 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 12:03:31.868942 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:31.868898 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-rbac-proxy-cm podName:c6c06582-b8ae-43a6-81b4-7366d2012e58 nodeName:}" failed. No retries permitted until 2026-07-08 12:03:35.868884421 +0000 UTC m=+127.228623706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fh2b6" (UID: "c6c06582-b8ae-43a6-81b4-7366d2012e58") : configmap "kube-rbac-proxy" not found Jul 08 12:03:31.868942 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:31.868905 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 12:03:31.869090 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:31.868960 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6c06582-b8ae-43a6-81b4-7366d2012e58-insights-runtime-extractor-tls podName:c6c06582-b8ae-43a6-81b4-7366d2012e58 nodeName:}" failed. No retries permitted until 2026-07-08 12:03:35.868948425 +0000 UTC m=+127.228687710 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6c06582-b8ae-43a6-81b4-7366d2012e58-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fh2b6" (UID: "c6c06582-b8ae-43a6-81b4-7366d2012e58") : secret "insights-runtime-extractor-tls" not found Jul 08 12:03:32.638887 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:32.638850 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:32.746396 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:32.746365 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:32.847518 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:32.847484 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:32.950456 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:32.950370 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:33.057129 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:33.057097 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:33.380637 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:33.380598 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:33.478128 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:33.478097 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:33.921437 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:33.921409 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:03:33.921809 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:33.921462 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:03:33.921809 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:33.921766 2560 scope.go:117] "RemoveContainer" containerID="0c22d65627394bcdf5eb8fbf3224a4c218286087105f9b3f51ae633d6a5579a2" Jul 08 12:03:33.921945 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:33.921905 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-jxw77_openshift-console-operator(b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd)\"" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" podUID="b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd" Jul 08 12:03:34.331692 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:34.331654 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:34.536357 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:34.536323 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:34.935615 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:34.935577 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:35.130776 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:35.130735 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:35.536558 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:35.536523 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:35.901895 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:35.901807 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6c06582-b8ae-43a6-81b4-7366d2012e58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:35.901895 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:35.901864 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:35.902099 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:35.901973 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 12:03:35.902099 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:35.902044 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6c06582-b8ae-43a6-81b4-7366d2012e58-insights-runtime-extractor-tls podName:c6c06582-b8ae-43a6-81b4-7366d2012e58 nodeName:}" failed. No retries permitted until 2026-07-08 12:03:43.902030034 +0000 UTC m=+135.261769319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6c06582-b8ae-43a6-81b4-7366d2012e58-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fh2b6" (UID: "c6c06582-b8ae-43a6-81b4-7366d2012e58") : secret "insights-runtime-extractor-tls" not found Jul 08 12:03:35.902099 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:35.901977 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 12:03:35.902212 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:35.902119 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-rbac-proxy-cm podName:c6c06582-b8ae-43a6-81b4-7366d2012e58 nodeName:}" failed. No retries permitted until 2026-07-08 12:03:43.902102566 +0000 UTC m=+135.261841868 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fh2b6" (UID: "c6c06582-b8ae-43a6-81b4-7366d2012e58") : configmap "kube-rbac-proxy" not found Jul 08 12:03:35.948009 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:35.947977 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:36.356608 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:36.356572 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:36.413339 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:36.413308 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:36.735615 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:36.735521 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:37.848147 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:37.848109 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:37.949055 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:37.949023 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:38.121875 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:38.121796 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs\") pod \"network-metrics-daemon-hpnpx\" (UID: \"129e9e1b-586a-4226-be04-0544c26f0d9d\") " pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:03:38.122037 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:38.121960 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 12:03:38.122037 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:38.122026 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs podName:129e9e1b-586a-4226-be04-0544c26f0d9d nodeName:}" failed. No retries permitted until 2026-07-08 12:05:40.12201123 +0000 UTC m=+251.481750518 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs") pod "network-metrics-daemon-hpnpx" (UID: "129e9e1b-586a-4226-be04-0544c26f0d9d") : secret "metrics-daemon-secret" not found Jul 08 12:03:38.330879 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:38.330845 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:38.566612 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:38.566573 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:38.628544 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:38.628507 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:38.930792 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:38.930706 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:39.133638 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:39.133609 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:39.431649 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:39.431615 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4rgw2\" (UID: \"de054497-a501-48d6-9337-823f98895573\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" Jul 08 12:03:39.431811 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:39.431770 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 12:03:39.431872 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:39.431844 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls podName:de054497-a501-48d6-9337-823f98895573 nodeName:}" failed. No retries permitted until 2026-07-08 12:03:55.43182761 +0000 UTC m=+146.791566894 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4rgw2" (UID: "de054497-a501-48d6-9337-823f98895573") : secret "cluster-monitoring-operator-tls" not found Jul 08 12:03:39.532471 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:39.532440 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8af93bb-fee4-4a90-ae96-efc184f3541f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-pkd4n\" (UID: \"c8af93bb-fee4-4a90-ae96-efc184f3541f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n" Jul 08 12:03:39.534869 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:39.534839 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8af93bb-fee4-4a90-ae96-efc184f3541f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-pkd4n\" (UID: \"c8af93bb-fee4-4a90-ae96-efc184f3541f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n" Jul 08 12:03:39.615977 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:39.615946 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zz76c\"" Jul 08 12:03:39.624027 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:39.624005 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n" Jul 08 12:03:39.738295 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:39.738250 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:39.750222 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:39.750186 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n"] Jul 08 12:03:39.936108 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:39.936074 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:40.533338 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:40.533299 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:40.544060 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:40.544028 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n" event={"ID":"c8af93bb-fee4-4a90-ae96-efc184f3541f","Type":"ContainerStarted","Data":"ecce95730be9c5bd499a220e88a7c28fe207e033ba4a422b3ee1c2cff3b144fc"} Jul 08 12:03:40.734150 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:40.734116 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:41.135176 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:41.135131 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:41.394541 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:41.394454 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:41.931488 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:41.931449 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:42.144208 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:42.144148 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:42.293477 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:42.293444 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:42.551169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:42.551079 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n" event={"ID":"c8af93bb-fee4-4a90-ae96-efc184f3541f","Type":"ContainerStarted","Data":"f05da3feba86aeec3e5d68a39936260c120ad46f00f8bc425d7a12b464a398ea"} Jul 08 12:03:42.551169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:42.551129 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n" event={"ID":"c8af93bb-fee4-4a90-ae96-efc184f3541f","Type":"ContainerStarted","Data":"7ffefb3dec3479a576967faabeaecf5c2e5ae91e2be490fce6a25134e14f4d57"} Jul 08 12:03:42.570515 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:42.570464 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-pkd4n" podStartSLOduration=17.038436416 podStartE2EDuration="19.570448369s" totalImagesPullingTime="2.532011953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:03:42.569077913 +0000 UTC m=+133.928817220" watchObservedRunningTime="2026-07-08 12:03:42.570448369 +0000 UTC m=+133.930187676" Jul 08 12:03:42.578594 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:42.578562 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:42.738193 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:42.738160 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:43.138517 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:43.138484 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:43.362852 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:43.362823 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:43.970021 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:43.969983 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6c06582-b8ae-43a6-81b4-7366d2012e58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:43.970175 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:43.970047 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:43.970556 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:43.970540 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6c06582-b8ae-43a6-81b4-7366d2012e58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:43.972287 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:43.972271 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6c06582-b8ae-43a6-81b4-7366d2012e58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fh2b6\" (UID: \"c6c06582-b8ae-43a6-81b4-7366d2012e58\") " pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:43.994317 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:43.994289 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6nfnf\"" Jul 08 12:03:44.002426 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:44.002404 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fh2b6" Jul 08 12:03:44.131024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:44.130999 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fh2b6"] Jul 08 12:03:44.133297 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:03:44.133271 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6c06582_b8ae_43a6_81b4_7366d2012e58.slice/crio-e6b041a58c22c0fa849d5b1ce73ad45142894fa5ae46041b6bdae40f9ac4d66d WatchSource:0}: Error finding container e6b041a58c22c0fa849d5b1ce73ad45142894fa5ae46041b6bdae40f9ac4d66d: Status 404 returned error can't find the container with id e6b041a58c22c0fa849d5b1ce73ad45142894fa5ae46041b6bdae40f9ac4d66d Jul 08 12:03:44.561715 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:44.561674 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fh2b6" event={"ID":"c6c06582-b8ae-43a6-81b4-7366d2012e58","Type":"ContainerStarted","Data":"e6b041a58c22c0fa849d5b1ce73ad45142894fa5ae46041b6bdae40f9ac4d66d"} Jul 08 12:03:45.127719 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:45.127629 2560 scope.go:117] "RemoveContainer" containerID="0c22d65627394bcdf5eb8fbf3224a4c218286087105f9b3f51ae633d6a5579a2" Jul 08 12:03:45.565758 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:45.565728 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:03:45.566227 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:45.566163 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/1.log" Jul 08 12:03:45.566227 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:45.566192 2560 generic.go:356] "Generic (PLEG): container finished" podID="b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd" containerID="4e74898e428ea1003ce3dce512230c585168d1034f7b57e0add0b9142a3441bb" exitCode=255 Jul 08 12:03:45.566340 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:45.566230 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" event={"ID":"b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd","Type":"ContainerDied","Data":"4e74898e428ea1003ce3dce512230c585168d1034f7b57e0add0b9142a3441bb"} Jul 08 12:03:45.566340 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:45.566275 2560 scope.go:117] "RemoveContainer" containerID="0c22d65627394bcdf5eb8fbf3224a4c218286087105f9b3f51ae633d6a5579a2" Jul 08 12:03:45.566655 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:45.566635 2560 scope.go:117] "RemoveContainer" containerID="4e74898e428ea1003ce3dce512230c585168d1034f7b57e0add0b9142a3441bb" Jul 08 12:03:45.566820 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:45.566800 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-jxw77_openshift-console-operator(b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd)\"" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" podUID="b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd" Jul 08 12:03:48.577319 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:48.577285 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fh2b6" event={"ID":"c6c06582-b8ae-43a6-81b4-7366d2012e58","Type":"ContainerStarted","Data":"edf6547130d6a11ba06d5012b912513b2461b98a201c70bcd653c62b28ac5382"} Jul 08 12:03:48.578666 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:48.578645 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:03:50.587199 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:50.587155 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fh2b6" event={"ID":"c6c06582-b8ae-43a6-81b4-7366d2012e58","Type":"ContainerStarted","Data":"b1f66bcff9fb5ce9c872adbe5fa8f20d0f209885ee0f980a2f3c369186e1b2dc"} Jul 08 12:03:52.595372 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:52.595273 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fh2b6" event={"ID":"c6c06582-b8ae-43a6-81b4-7366d2012e58","Type":"ContainerStarted","Data":"428f25917e6b1890aba614ffca47db12658eb608af34fed4335e032d04ee100b"} Jul 08 12:03:52.614674 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:52.614621 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fh2b6" podStartSLOduration=16.593182944 podStartE2EDuration="24.614606488s" totalImagesPullingTime="8.021423544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 12:03:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:03:52.613357032 +0000 UTC m=+143.973096338" watchObservedRunningTime="2026-07-08 12:03:52.614606488 +0000 UTC m=+143.974345794" Jul 08 12:03:53.920882 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:53.920851 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:03:53.921281 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:53.920905 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:03:53.921281 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:53.921228 2560 scope.go:117] "RemoveContainer" containerID="4e74898e428ea1003ce3dce512230c585168d1034f7b57e0add0b9142a3441bb" Jul 08 12:03:53.921392 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:03:53.921361 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-jxw77_openshift-console-operator(b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd)\"" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" podUID="b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd" Jul 08 12:03:54.095695 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:54.094103 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-7lld4"] Jul 08 12:03:54.098273 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:54.098245 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7lld4" Jul 08 12:03:54.100832 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:54.100810 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 08 12:03:54.100954 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:54.100810 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 08 12:03:54.101013 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:54.100995 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rnjbn\"" Jul 08 12:03:54.108117 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:54.108095 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-7lld4"] Jul 08 12:03:54.154113 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:54.154084 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ee7138e9-50b0-4552-a2a0-1ac74d70b886-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7lld4\" (UID: \"ee7138e9-50b0-4552-a2a0-1ac74d70b886\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7lld4" Jul 08 12:03:54.154248 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:54.154128 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ee7138e9-50b0-4552-a2a0-1ac74d70b886-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-7lld4\" (UID: \"ee7138e9-50b0-4552-a2a0-1ac74d70b886\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7lld4" Jul 08 12:03:54.255270 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:54.255174 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ee7138e9-50b0-4552-a2a0-1ac74d70b886-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7lld4\" (UID: \"ee7138e9-50b0-4552-a2a0-1ac74d70b886\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7lld4" Jul 08 12:03:54.255270 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:54.255227 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ee7138e9-50b0-4552-a2a0-1ac74d70b886-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-7lld4\" (UID: \"ee7138e9-50b0-4552-a2a0-1ac74d70b886\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7lld4" Jul 08 12:03:54.255895 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:54.255868 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ee7138e9-50b0-4552-a2a0-1ac74d70b886-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-7lld4\" (UID: \"ee7138e9-50b0-4552-a2a0-1ac74d70b886\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7lld4" Jul 08 12:03:54.257707 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:54.257678 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ee7138e9-50b0-4552-a2a0-1ac74d70b886-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7lld4\" (UID: \"ee7138e9-50b0-4552-a2a0-1ac74d70b886\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7lld4" Jul 08 12:03:54.316296 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:54.316261 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:54.406678 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:54.406633 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7lld4" Jul 08 12:03:54.412523 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:54.412489 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:54.529991 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:54.529963 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-7lld4"] Jul 08 12:03:54.532807 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:03:54.532785 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee7138e9_50b0_4552_a2a0_1ac74d70b886.slice/crio-e8e36c833b8da1f657599aead76db643afd66e16653026524f921fce4f485168 WatchSource:0}: Error finding container e8e36c833b8da1f657599aead76db643afd66e16653026524f921fce4f485168: Status 404 returned error can't find the container with id e8e36c833b8da1f657599aead76db643afd66e16653026524f921fce4f485168 Jul 08 12:03:54.604174 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:54.604136 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7lld4" event={"ID":"ee7138e9-50b0-4552-a2a0-1ac74d70b886","Type":"ContainerStarted","Data":"e8e36c833b8da1f657599aead76db643afd66e16653026524f921fce4f485168"} Jul 08 12:03:55.463118 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:55.463079 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4rgw2\" (UID: \"de054497-a501-48d6-9337-823f98895573\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" Jul 08 12:03:55.465655 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:55.465627 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de054497-a501-48d6-9337-823f98895573-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4rgw2\" (UID: \"de054497-a501-48d6-9337-823f98895573\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" Jul 08 12:03:55.683771 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:55.683736 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:55.717552 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:55.717477 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6k64w\"" Jul 08 12:03:55.724816 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:55.724784 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" Jul 08 12:03:55.741772 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:55.741740 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:56.081867 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:56.081846 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2"] Jul 08 12:03:56.085148 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:03:56.085123 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde054497_a501_48d6_9337_823f98895573.slice/crio-816360ec8ebaee20a1464a3347939ed5b0c8bb7d8023a8fdb04c7dba26cd22b5 WatchSource:0}: Error finding container 816360ec8ebaee20a1464a3347939ed5b0c8bb7d8023a8fdb04c7dba26cd22b5: Status 404 returned error can't find the container with id 816360ec8ebaee20a1464a3347939ed5b0c8bb7d8023a8fdb04c7dba26cd22b5 Jul 08 12:03:56.612647 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:56.612614 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" event={"ID":"de054497-a501-48d6-9337-823f98895573","Type":"ContainerStarted","Data":"816360ec8ebaee20a1464a3347939ed5b0c8bb7d8023a8fdb04c7dba26cd22b5"} Jul 08 12:03:56.614051 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:56.614028 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7lld4" event={"ID":"ee7138e9-50b0-4552-a2a0-1ac74d70b886","Type":"ContainerStarted","Data":"b4f877cba0e3fec8e556f06bd86c7856cfe809f97bd39f67deeccdfba5f29831"} Jul 08 12:03:56.631353 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:56.631308 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7lld4" podStartSLOduration=1.167056634 podStartE2EDuration="2.631292746s" totalImagesPullingTime="1.464236112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:03:56.630583882 +0000 UTC m=+147.990323188" watchObservedRunningTime="2026-07-08 12:03:56.631292746 +0000 UTC m=+147.991032054" Jul 08 12:03:56.748024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:56.747990 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:56.849091 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:56.849055 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:56.908270 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:56.908170 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:58.413883 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:58.413789 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:58.512863 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:58.512831 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:58.614020 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:58.613987 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:58.617127 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:58.617099 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx86r"] Jul 08 12:03:58.620275 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:58.620258 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx86r" Jul 08 12:03:58.622698 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:58.622673 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 08 12:03:58.622943 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:58.622921 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-j7t4s\"" Jul 08 12:03:58.625384 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:58.625363 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" event={"ID":"de054497-a501-48d6-9337-823f98895573","Type":"ContainerStarted","Data":"b0f1b829b789ffcda339a7241b73014578aa8e6c9eea147e48f39395e982f270"} Jul 08 12:03:58.628899 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:58.628880 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx86r"] Jul 08 12:03:58.662334 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:58.662281 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4rgw2" podStartSLOduration=33.656513915 podStartE2EDuration="35.662263135s" totalImagesPullingTime="2.00574922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:03:58.661667249 +0000 UTC m=+150.021406556" watchObservedRunningTime="2026-07-08 12:03:58.662263135 +0000 UTC m=+150.022002441" Jul 08 12:03:58.683253 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:58.683190 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f132a561-f51c-4df7-9f1f-38e5fb2ce7de-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fx86r\" (UID: \"f132a561-f51c-4df7-9f1f-38e5fb2ce7de\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx86r" Jul 08 12:03:58.766021 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:58.765986 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:03:58.784154 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:58.784116 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f132a561-f51c-4df7-9f1f-38e5fb2ce7de-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fx86r\" (UID: \"f132a561-f51c-4df7-9f1f-38e5fb2ce7de\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx86r" Jul 08 12:03:58.786701 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:58.786672 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f132a561-f51c-4df7-9f1f-38e5fb2ce7de-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fx86r\" (UID: \"f132a561-f51c-4df7-9f1f-38e5fb2ce7de\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx86r" Jul 08 12:03:58.930812 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:58.930770 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx86r" Jul 08 12:03:59.057220 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:59.057197 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx86r"] Jul 08 12:03:59.058982 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:03:59.058954 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf132a561_f51c_4df7_9f1f_38e5fb2ce7de.slice/crio-a320dc9690231a76433bf367bd742e563167f04f566425440f01d54e6447f59e WatchSource:0}: Error finding container a320dc9690231a76433bf367bd742e563167f04f566425440f01d54e6447f59e: Status 404 returned error can't find the container with id a320dc9690231a76433bf367bd742e563167f04f566425440f01d54e6447f59e Jul 08 12:03:59.629156 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:03:59.629122 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx86r" event={"ID":"f132a561-f51c-4df7-9f1f-38e5fb2ce7de","Type":"ContainerStarted","Data":"a320dc9690231a76433bf367bd742e563167f04f566425440f01d54e6447f59e"} Jul 08 12:04:00.633975 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:00.633868 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx86r" event={"ID":"f132a561-f51c-4df7-9f1f-38e5fb2ce7de","Type":"ContainerStarted","Data":"e30bb1d310ee00727c6754a8a47478ebdea4ce40a75576366bba794ebd632430"} Jul 08 12:04:00.634357 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:00.634059 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx86r" Jul 08 12:04:00.638783 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:00.638763 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx86r" Jul 08 12:04:00.651528 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:00.651487 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx86r" podStartSLOduration=1.342486646 podStartE2EDuration="2.651472431s" totalImagesPullingTime="1.308985785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:04:00.651011299 +0000 UTC m=+152.010750606" watchObservedRunningTime="2026-07-08 12:04:00.651472431 +0000 UTC m=+152.011211737" Jul 08 12:04:01.634411 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:01.634377 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:01.701210 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:01.701178 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:01.868745 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:01.868710 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:03.059196 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:03.059162 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:03.128586 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:03.128551 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:05.656250 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:05.656210 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:05.890250 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:05.890201 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:05.989885 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:05.989805 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:06.511374 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:04:06.511328 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" podUID="ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c" Jul 08 12:04:06.524499 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:04:06.524464 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vcls6" podUID="785fe3cf-57e7-4673-b7a8-8e40ec6d68bf" Jul 08 12:04:06.653585 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:06.653555 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vcls6" Jul 08 12:04:07.127549 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:07.127520 2560 scope.go:117] "RemoveContainer" containerID="4e74898e428ea1003ce3dce512230c585168d1034f7b57e0add0b9142a3441bb" Jul 08 12:04:07.658050 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:07.658025 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:04:07.658211 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:07.658082 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" event={"ID":"b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd","Type":"ContainerStarted","Data":"b27bdd6ca2163d6e9c55401b6f56bf3f25064dfa4cf115d04ef60ce981c8b9d5"} Jul 08 12:04:07.658364 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:07.658342 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:04:07.678370 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:07.678317 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" podStartSLOduration=41.091104706 podStartE2EDuration="44.678301214s" totalImagesPullingTime="3.587196508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:04:07.677591693 +0000 UTC m=+159.037331001" watchObservedRunningTime="2026-07-08 12:04:07.678301214 +0000 UTC m=+159.038040522" Jul 08 12:04:07.772828 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:07.772777 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:07.932469 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:07.932374 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:08.031176 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.031143 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6"] Jul 08 12:04:08.031497 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.031460 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:08.034750 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.034732 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" Jul 08 12:04:08.037414 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.037389 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 08 12:04:08.037702 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.037683 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rrjvr\"" Jul 08 12:04:08.037784 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.037722 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 12:04:08.038012 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.037997 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 08 12:04:08.044563 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.044536 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6"] Jul 08 12:04:08.047044 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.047025 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-48skh"] Jul 08 12:04:08.050194 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.050172 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.053000 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.052980 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 12:04:08.053207 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.053183 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 12:04:08.053207 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.053197 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pnlbh\"" Jul 08 12:04:08.053313 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.053216 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 12:04:08.056941 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.056903 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/337f924e-e46b-4065-99de-6182b2430841-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-247m6\" (UID: \"337f924e-e46b-4065-99de-6182b2430841\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" Jul 08 12:04:08.057037 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.057020 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/337f924e-e46b-4065-99de-6182b2430841-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-247m6\" (UID: \"337f924e-e46b-4065-99de-6182b2430841\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" Jul 08 12:04:08.057087 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.057072 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/337f924e-e46b-4065-99de-6182b2430841-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-247m6\" (UID: \"337f924e-e46b-4065-99de-6182b2430841\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" Jul 08 12:04:08.057135 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.057122 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2cq2\" (UniqueName: \"kubernetes.io/projected/337f924e-e46b-4065-99de-6182b2430841-kube-api-access-c2cq2\") pod \"openshift-state-metrics-54cf96dfcf-247m6\" (UID: \"337f924e-e46b-4065-99de-6182b2430841\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" Jul 08 12:04:08.058360 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.058338 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt"] Jul 08 12:04:08.061902 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.061884 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.065484 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.065467 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 08 12:04:08.065723 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.065680 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2jc9h\"" Jul 08 12:04:08.065826 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.065731 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 08 12:04:08.065826 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.065770 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 08 12:04:08.073967 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.073943 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt"] Jul 08 12:04:08.110366 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.110330 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:08.150581 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:04:08.150539 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hpnpx" podUID="129e9e1b-586a-4226-be04-0544c26f0d9d" Jul 08 12:04:08.157898 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.157866 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9d50282a-d27a-4349-b2e0-919b803a1df8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.158054 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.157977 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-metrics-client-ca\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.158054 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.158034 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/337f924e-e46b-4065-99de-6182b2430841-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-247m6\" (UID: \"337f924e-e46b-4065-99de-6182b2430841\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" Jul 08 12:04:08.158121 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.158079 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d50282a-d27a-4349-b2e0-919b803a1df8-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.158121 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.158104 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-root\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.158180 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.158135 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-node-exporter-wtmp\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.158180 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.158163 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-node-exporter-textfile\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.158260 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.158193 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/337f924e-e46b-4065-99de-6182b2430841-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-247m6\" (UID: \"337f924e-e46b-4065-99de-6182b2430841\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" Jul 08 12:04:08.158260 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.158229 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d50282a-d27a-4349-b2e0-919b803a1df8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.158333 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.158256 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d50282a-d27a-4349-b2e0-919b803a1df8-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.158333 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:04:08.158316 2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 08 12:04:08.158425 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.158315 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-node-exporter-tls\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.158425 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:04:08.158378 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/337f924e-e46b-4065-99de-6182b2430841-openshift-state-metrics-tls podName:337f924e-e46b-4065-99de-6182b2430841 nodeName:}" failed. No retries permitted until 2026-07-08 12:04:08.658364996 +0000 UTC m=+160.018104280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/337f924e-e46b-4065-99de-6182b2430841-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-247m6" (UID: "337f924e-e46b-4065-99de-6182b2430841") : secret "openshift-state-metrics-tls" not found Jul 08 12:04:08.158538 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.158426 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-sys\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.158538 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.158462 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2cq2\" (UniqueName: \"kubernetes.io/projected/337f924e-e46b-4065-99de-6182b2430841-kube-api-access-c2cq2\") pod \"openshift-state-metrics-54cf96dfcf-247m6\" (UID: \"337f924e-e46b-4065-99de-6182b2430841\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" Jul 08 12:04:08.158538 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.158503 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/337f924e-e46b-4065-99de-6182b2430841-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-247m6\" (UID: \"337f924e-e46b-4065-99de-6182b2430841\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" Jul 08 12:04:08.158695 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.158550 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-node-exporter-accelerators-collector-config\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.158695 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.158578 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4dvq\" (UniqueName: \"kubernetes.io/projected/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-kube-api-access-j4dvq\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.158695 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.158608 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9d50282a-d27a-4349-b2e0-919b803a1df8-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.158695 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.158635 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p92sd\" (UniqueName: \"kubernetes.io/projected/9d50282a-d27a-4349-b2e0-919b803a1df8-kube-api-access-p92sd\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.158865 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.158695 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.159110 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.159093 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/337f924e-e46b-4065-99de-6182b2430841-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-247m6\" (UID: \"337f924e-e46b-4065-99de-6182b2430841\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" Jul 08 12:04:08.160475 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.160451 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/337f924e-e46b-4065-99de-6182b2430841-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-247m6\" (UID: \"337f924e-e46b-4065-99de-6182b2430841\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" Jul 08 12:04:08.167546 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.167520 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2cq2\" (UniqueName: \"kubernetes.io/projected/337f924e-e46b-4065-99de-6182b2430841-kube-api-access-c2cq2\") pod \"openshift-state-metrics-54cf96dfcf-247m6\" (UID: \"337f924e-e46b-4065-99de-6182b2430841\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" Jul 08 12:04:08.180528 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.180497 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:08.260120 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.260089 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9d50282a-d27a-4349-b2e0-919b803a1df8-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.260306 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.260130 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p92sd\" (UniqueName: \"kubernetes.io/projected/9d50282a-d27a-4349-b2e0-919b803a1df8-kube-api-access-p92sd\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.260306 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.260158 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.260306 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.260193 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9d50282a-d27a-4349-b2e0-919b803a1df8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.260306 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.260232 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-metrics-client-ca\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.260306 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.260271 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d50282a-d27a-4349-b2e0-919b803a1df8-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.260306 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.260291 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-root\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.260595 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:04:08.260356 2560 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 08 12:04:08.260595 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:04:08.260421 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d50282a-d27a-4349-b2e0-919b803a1df8-kube-state-metrics-tls podName:9d50282a-d27a-4349-b2e0-919b803a1df8 nodeName:}" failed. No retries permitted until 2026-07-08 12:04:08.760402703 +0000 UTC m=+160.120141998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9d50282a-d27a-4349-b2e0-919b803a1df8-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-ndltt" (UID: "9d50282a-d27a-4349-b2e0-919b803a1df8") : secret "kube-state-metrics-tls" not found Jul 08 12:04:08.260595 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.260357 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-root\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.260595 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.260494 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-node-exporter-wtmp\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.260595 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.260532 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-node-exporter-textfile\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.260595 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.260559 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9d50282a-d27a-4349-b2e0-919b803a1df8-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.260595 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.260589 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d50282a-d27a-4349-b2e0-919b803a1df8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.260947 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.260625 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d50282a-d27a-4349-b2e0-919b803a1df8-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.260947 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.260668 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-node-exporter-tls\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.260947 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.260694 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-sys\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.260947 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.260738 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-node-exporter-wtmp\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.260947 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.260754 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-node-exporter-accelerators-collector-config\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.260947 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.260780 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4dvq\" (UniqueName: \"kubernetes.io/projected/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-kube-api-access-j4dvq\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.261260 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.261228 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-sys\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.261352 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:04:08.261326 2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 12:04:08.261402 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:04:08.261390 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-node-exporter-tls podName:1637c5f8-5a50-41de-8f84-f0d05ad5f4bc nodeName:}" failed. No retries permitted until 2026-07-08 12:04:08.761373175 +0000 UTC m=+160.121112464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-node-exporter-tls") pod "node-exporter-48skh" (UID: "1637c5f8-5a50-41de-8f84-f0d05ad5f4bc") : secret "node-exporter-tls" not found Jul 08 12:04:08.261704 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.261670 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-node-exporter-textfile\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.261995 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.261975 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-metrics-client-ca\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.262278 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.262257 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9d50282a-d27a-4349-b2e0-919b803a1df8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.266998 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.262713 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d50282a-d27a-4349-b2e0-919b803a1df8-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.266998 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.263002 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-node-exporter-accelerators-collector-config\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.266998 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.263226 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.267814 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.267792 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d50282a-d27a-4349-b2e0-919b803a1df8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.270182 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.270148 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p92sd\" (UniqueName: \"kubernetes.io/projected/9d50282a-d27a-4349-b2e0-919b803a1df8-kube-api-access-p92sd\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.270759 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.270739 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4dvq\" (UniqueName: \"kubernetes.io/projected/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-kube-api-access-j4dvq\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.373369 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.373330 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:08.489550 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.489513 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:08.635763 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.635734 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-jxw77" Jul 08 12:04:08.664831 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.664794 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/337f924e-e46b-4065-99de-6182b2430841-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-247m6\" (UID: \"337f924e-e46b-4065-99de-6182b2430841\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" Jul 08 12:04:08.667684 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.667653 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/337f924e-e46b-4065-99de-6182b2430841-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-247m6\" (UID: \"337f924e-e46b-4065-99de-6182b2430841\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" Jul 08 12:04:08.766174 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.766143 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d50282a-d27a-4349-b2e0-919b803a1df8-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.766361 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.766217 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-node-exporter-tls\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.768806 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.768778 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d50282a-d27a-4349-b2e0-919b803a1df8-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-ndltt\" (UID: \"9d50282a-d27a-4349-b2e0-919b803a1df8\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.768939 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.768926 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1637c5f8-5a50-41de-8f84-f0d05ad5f4bc-node-exporter-tls\") pod \"node-exporter-48skh\" (UID: \"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc\") " pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.944738 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.944653 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" Jul 08 12:04:08.960058 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.960025 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-48skh" Jul 08 12:04:08.970086 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:08.970059 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" Jul 08 12:04:08.970370 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:04:08.970350 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1637c5f8_5a50_41de_8f84_f0d05ad5f4bc.slice/crio-4917753e43e00b1f5ecb6a56b33f9e67c1ae76575d7e9fa2a238d2f3d0ae222e WatchSource:0}: Error finding container 4917753e43e00b1f5ecb6a56b33f9e67c1ae76575d7e9fa2a238d2f3d0ae222e: Status 404 returned error can't find the container with id 4917753e43e00b1f5ecb6a56b33f9e67c1ae76575d7e9fa2a238d2f3d0ae222e Jul 08 12:04:09.111075 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:09.110981 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6"] Jul 08 12:04:09.115116 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:04:09.115090 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod337f924e_e46b_4065_99de_6182b2430841.slice/crio-9ec380ed533ebcfe78f0becdf5d6b8d012e21811ad42ec6f8d0378f19cee4a02 WatchSource:0}: Error finding container 9ec380ed533ebcfe78f0becdf5d6b8d012e21811ad42ec6f8d0378f19cee4a02: Status 404 returned error can't find the container with id 9ec380ed533ebcfe78f0becdf5d6b8d012e21811ad42ec6f8d0378f19cee4a02 Jul 08 12:04:09.149793 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:09.149767 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt"] Jul 08 12:04:09.152607 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:04:09.152568 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d50282a_d27a_4349_b2e0_919b803a1df8.slice/crio-1ecf8fee09f51a7bfc65aaa301d38bf2a026b6d1f357f097443941009a5e6f8e WatchSource:0}: Error finding container 1ecf8fee09f51a7bfc65aaa301d38bf2a026b6d1f357f097443941009a5e6f8e: Status 404 returned error can't find the container with id 1ecf8fee09f51a7bfc65aaa301d38bf2a026b6d1f357f097443941009a5e6f8e Jul 08 12:04:09.218379 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:09.218348 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:09.301165 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:09.301127 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:09.366763 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:09.366653 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:09.668039 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:09.668002 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-48skh" event={"ID":"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc","Type":"ContainerStarted","Data":"4917753e43e00b1f5ecb6a56b33f9e67c1ae76575d7e9fa2a238d2f3d0ae222e"} Jul 08 12:04:09.670401 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:09.670366 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" event={"ID":"337f924e-e46b-4065-99de-6182b2430841","Type":"ContainerStarted","Data":"2885e558a3ab23afc134bf2a927c6780f1c3247b5d90159ee4c2b6e6c186e2c1"} Jul 08 12:04:09.670535 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:09.670433 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" event={"ID":"337f924e-e46b-4065-99de-6182b2430841","Type":"ContainerStarted","Data":"ced2492b7b64ffa01ec3dcc42124b05a84af3e7efa16eb8a6173b51c60f16032"} Jul 08 12:04:09.670535 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:09.670464 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" event={"ID":"337f924e-e46b-4065-99de-6182b2430841","Type":"ContainerStarted","Data":"9ec380ed533ebcfe78f0becdf5d6b8d012e21811ad42ec6f8d0378f19cee4a02"} Jul 08 12:04:09.671755 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:09.671728 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" event={"ID":"9d50282a-d27a-4349-b2e0-919b803a1df8","Type":"ContainerStarted","Data":"1ecf8fee09f51a7bfc65aaa301d38bf2a026b6d1f357f097443941009a5e6f8e"} Jul 08 12:04:09.790269 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:09.790238 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:09.883886 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:09.883854 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:09.983578 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:09.983499 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:10.111167 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:10.111126 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:10.215634 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:10.215526 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:10.572243 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:10.572208 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:10.677142 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:10.677109 2560 generic.go:356] "Generic (PLEG): container finished" podID="1637c5f8-5a50-41de-8f84-f0d05ad5f4bc" containerID="47ec76c49893f3f9114c2bf7ce3a7d7cc573f51bedfc27ab5775bb254638239e" exitCode=0 Jul 08 12:04:10.677336 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:10.677165 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-48skh" event={"ID":"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc","Type":"ContainerDied","Data":"47ec76c49893f3f9114c2bf7ce3a7d7cc573f51bedfc27ab5775bb254638239e"} Jul 08 12:04:10.734060 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:10.734016 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:10.878741 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:10.878631 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:11.158671 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.158559 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:11.258937 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.258829 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:11.339171 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.339135 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-866d7745cc-5n4vf"] Jul 08 12:04:11.343275 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.343254 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.346610 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.346588 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 08 12:04:11.346762 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.346745 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fsqrl\"" Jul 08 12:04:11.346898 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.346881 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 08 12:04:11.347168 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.347153 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 08 12:04:11.347287 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.347272 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-tl82n88f5jk6\"" Jul 08 12:04:11.350176 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.350157 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 08 12:04:11.350339 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.350199 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 08 12:04:11.365316 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.365291 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-866d7745cc-5n4vf"] Jul 08 12:04:11.390591 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.390498 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e9ad891-b318-43af-b261-7ac068d135e2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.390591 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.390547 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0e9ad891-b318-43af-b261-7ac068d135e2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.390591 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.390581 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e9ad891-b318-43af-b261-7ac068d135e2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.390878 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.390652 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0e9ad891-b318-43af-b261-7ac068d135e2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.390878 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.390695 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e9ad891-b318-43af-b261-7ac068d135e2-secret-grpc-tls\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.390878 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.390748 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:04:11.390878 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.390798 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwcv4\" (UniqueName: \"kubernetes.io/projected/0e9ad891-b318-43af-b261-7ac068d135e2-kube-api-access-zwcv4\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.390878 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.390833 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:04:11.390878 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.390870 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e9ad891-b318-43af-b261-7ac068d135e2-metrics-client-ca\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.391189 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.390898 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0e9ad891-b318-43af-b261-7ac068d135e2-secret-thanos-querier-tls\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.393247 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.393221 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/785fe3cf-57e7-4673-b7a8-8e40ec6d68bf-metrics-tls\") pod \"dns-default-vcls6\" (UID: \"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf\") " pod="openshift-dns/dns-default-vcls6" Jul 08 12:04:11.393376 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.393265 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls\") pod \"image-registry-6f95f45b8f-5qdqk\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:04:11.453543 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.453506 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:11.456557 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.456540 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5pzr4\"" Jul 08 12:04:11.464822 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.464796 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vcls6" Jul 08 12:04:11.492074 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.492043 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e9ad891-b318-43af-b261-7ac068d135e2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.492074 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.492077 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0e9ad891-b318-43af-b261-7ac068d135e2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.492308 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.492101 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e9ad891-b318-43af-b261-7ac068d135e2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.492308 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.492121 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0e9ad891-b318-43af-b261-7ac068d135e2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.492308 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.492143 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e9ad891-b318-43af-b261-7ac068d135e2-secret-grpc-tls\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.492308 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.492183 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwcv4\" (UniqueName: \"kubernetes.io/projected/0e9ad891-b318-43af-b261-7ac068d135e2-kube-api-access-zwcv4\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.492308 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.492219 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e9ad891-b318-43af-b261-7ac068d135e2-metrics-client-ca\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.492308 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.492248 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0e9ad891-b318-43af-b261-7ac068d135e2-secret-thanos-querier-tls\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.493472 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.493415 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e9ad891-b318-43af-b261-7ac068d135e2-metrics-client-ca\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.495212 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.495185 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0e9ad891-b318-43af-b261-7ac068d135e2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.495655 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.495628 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e9ad891-b318-43af-b261-7ac068d135e2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.495767 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.495704 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0e9ad891-b318-43af-b261-7ac068d135e2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.496510 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.496128 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0e9ad891-b318-43af-b261-7ac068d135e2-secret-thanos-querier-tls\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.496510 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.496176 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e9ad891-b318-43af-b261-7ac068d135e2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.496661 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.496600 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e9ad891-b318-43af-b261-7ac068d135e2-secret-grpc-tls\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.500925 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.500895 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwcv4\" (UniqueName: \"kubernetes.io/projected/0e9ad891-b318-43af-b261-7ac068d135e2-kube-api-access-zwcv4\") pod \"thanos-querier-866d7745cc-5n4vf\" (UID: \"0e9ad891-b318-43af-b261-7ac068d135e2\") " pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.553866 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.553827 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:11.607998 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.607788 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vcls6"] Jul 08 12:04:11.610483 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:04:11.610459 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod785fe3cf_57e7_4673_b7a8_8e40ec6d68bf.slice/crio-554e2518637ec1c64933529020cbe11a7f7fad8b4701955944cb5e4c84fa6604 WatchSource:0}: Error finding container 554e2518637ec1c64933529020cbe11a7f7fad8b4701955944cb5e4c84fa6604: Status 404 returned error can't find the container with id 554e2518637ec1c64933529020cbe11a7f7fad8b4701955944cb5e4c84fa6604 Jul 08 12:04:11.653314 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.653209 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:11.655263 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.655231 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:11.683128 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.683093 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" event={"ID":"9d50282a-d27a-4349-b2e0-919b803a1df8","Type":"ContainerStarted","Data":"5df21a323ffd7cf1df67df10731dc9d4eda3aff196d5f892f7444266afe0a9fe"} Jul 08 12:04:11.683296 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.683168 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" event={"ID":"9d50282a-d27a-4349-b2e0-919b803a1df8","Type":"ContainerStarted","Data":"efefc5b88fd7d923d13983449103bc519d0b4cd5f5280601ee01a553eb5ddbda"} Jul 08 12:04:11.683296 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.683198 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" event={"ID":"9d50282a-d27a-4349-b2e0-919b803a1df8","Type":"ContainerStarted","Data":"cf77bc64fa24b4686f20fe6a6e4378d69f94f7e69f42b50115d10034eb80e586"} Jul 08 12:04:11.685307 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.685278 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-48skh" event={"ID":"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc","Type":"ContainerStarted","Data":"f8653de4c5d7efdf7179d7dc6c847b6399061bba4c26f89d18b282d8f2ed07ba"} Jul 08 12:04:11.685431 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.685337 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-48skh" event={"ID":"1637c5f8-5a50-41de-8f84-f0d05ad5f4bc","Type":"ContainerStarted","Data":"631802a3903bd45d3a42bf62557ebdcffa9554dfd83851c1004dbd30c16dad73"} Jul 08 12:04:11.687508 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.687489 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" event={"ID":"337f924e-e46b-4065-99de-6182b2430841","Type":"ContainerStarted","Data":"f7ffbaac10e235a53a52e2bdb4e89ff61223a515a774db635ecd3d04f02bdb3d"} Jul 08 12:04:11.688698 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.688672 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vcls6" event={"ID":"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf","Type":"ContainerStarted","Data":"554e2518637ec1c64933529020cbe11a7f7fad8b4701955944cb5e4c84fa6604"} Jul 08 12:04:11.709787 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.709732 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-ndltt" podStartSLOduration=1.828110369 podStartE2EDuration="3.709709845s" totalImagesPullingTime="1.881599476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:04:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:04:11.7094205 +0000 UTC m=+163.069159828" watchObservedRunningTime="2026-07-08 12:04:11.709709845 +0000 UTC m=+163.069449151" Jul 08 12:04:11.733191 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.733141 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-247m6" podStartSLOduration=1.958305338 podStartE2EDuration="3.733125854s" totalImagesPullingTime="1.774820516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:04:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:04:11.732074814 +0000 UTC m=+163.091814122" watchObservedRunningTime="2026-07-08 12:04:11.733125854 +0000 UTC m=+163.092865160" Jul 08 12:04:11.757189 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.757138 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-48skh" podStartSLOduration=2.811670607 podStartE2EDuration="3.757122131s" totalImagesPullingTime="877.068934ms" totalInitContainerRuntime="68.38259ms" isStatefulPod=true podCreationTimestamp="2026-07-08 12:04:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:04:11.755134292 +0000 UTC m=+163.114873601" watchObservedRunningTime="2026-07-08 12:04:11.757122131 +0000 UTC m=+163.116861491" Jul 08 12:04:11.790926 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:11.790882 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-866d7745cc-5n4vf"] Jul 08 12:04:11.794220 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:04:11.794185 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9ad891_b318_43af_b261_7ac068d135e2.slice/crio-e8db72221e9147d1b573540985f2f21b0f92af3d0817751c40c8a0fc77620881 WatchSource:0}: Error finding container e8db72221e9147d1b573540985f2f21b0f92af3d0817751c40c8a0fc77620881: Status 404 returned error can't find the container with id e8db72221e9147d1b573540985f2f21b0f92af3d0817751c40c8a0fc77620881 Jul 08 12:04:12.637727 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.637688 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-78d858979-wrqzz"] Jul 08 12:04:12.642402 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.642381 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.646214 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.646176 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-fqkql\"" Jul 08 12:04:12.646214 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.646186 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 08 12:04:12.646214 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.646203 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 12:04:12.646495 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.646238 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 08 12:04:12.646495 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.646176 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 08 12:04:12.646495 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.646176 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5dnko9gugu34p\"" Jul 08 12:04:12.648772 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.648710 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78d858979-wrqzz"] Jul 08 12:04:12.693711 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.693672 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" event={"ID":"0e9ad891-b318-43af-b261-7ac068d135e2","Type":"ContainerStarted","Data":"e8db72221e9147d1b573540985f2f21b0f92af3d0817751c40c8a0fc77620881"} Jul 08 12:04:12.703587 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.703558 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-audit-log\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.703736 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.703594 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-metrics-server-audit-profiles\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.703736 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.703615 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-secret-metrics-server-client-certs\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.703736 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.703634 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-secret-metrics-server-tls\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.703736 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.703719 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smj85\" (UniqueName: \"kubernetes.io/projected/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-kube-api-access-smj85\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.703886 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.703764 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.703886 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.703838 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-client-ca-bundle\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.804299 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.804266 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smj85\" (UniqueName: \"kubernetes.io/projected/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-kube-api-access-smj85\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.804489 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.804357 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.804489 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.804393 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-client-ca-bundle\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.804690 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.804663 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-audit-log\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.804781 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.804759 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-metrics-server-audit-profiles\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.805038 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.805017 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-audit-log\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.805134 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.805025 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-secret-metrics-server-client-certs\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.805134 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.805081 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-secret-metrics-server-tls\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.805267 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.805239 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.805821 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.805795 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-metrics-server-audit-profiles\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.807630 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.807605 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-client-ca-bundle\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.807838 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.807819 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-secret-metrics-server-tls\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.808236 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.808216 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-secret-metrics-server-client-certs\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.822482 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.822461 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smj85\" (UniqueName: \"kubernetes.io/projected/5fcfd64b-c504-4e26-9221-23ceb7c65a5a-kube-api-access-smj85\") pod \"metrics-server-78d858979-wrqzz\" (UID: \"5fcfd64b-c504-4e26-9221-23ceb7c65a5a\") " pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:12.826418 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.826379 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:12.917900 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.917801 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:12.952433 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:12.952404 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:13.107124 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.107005 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78d858979-wrqzz"] Jul 08 12:04:13.267768 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.267741 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-54f7b898c9-jdsg4"] Jul 08 12:04:13.272298 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.272274 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.275160 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.275142 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 08 12:04:13.275510 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.275487 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 08 12:04:13.275610 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.275516 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 08 12:04:13.275610 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.275493 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 08 12:04:13.275610 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.275524 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 08 12:04:13.275610 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.275601 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-c7wd9\"" Jul 08 12:04:13.281211 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.281181 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 08 12:04:13.287971 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.287949 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-54f7b898c9-jdsg4"] Jul 08 12:04:13.309183 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.309153 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e4bde902-e7fb-4287-840f-b96bee18640f-federate-client-tls\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.309332 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.309207 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4bde902-e7fb-4287-840f-b96bee18640f-serving-certs-ca-bundle\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.309332 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.309269 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e4bde902-e7fb-4287-840f-b96bee18640f-telemeter-client-tls\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.309332 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.309311 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4bde902-e7fb-4287-840f-b96bee18640f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.309470 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.309341 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pjjk\" (UniqueName: \"kubernetes.io/projected/e4bde902-e7fb-4287-840f-b96bee18640f-kube-api-access-7pjjk\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.309470 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.309398 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4bde902-e7fb-4287-840f-b96bee18640f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.309470 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.309426 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e4bde902-e7fb-4287-840f-b96bee18640f-secret-telemeter-client\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.309607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.309516 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4bde902-e7fb-4287-840f-b96bee18640f-metrics-client-ca\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.410482 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.410448 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e4bde902-e7fb-4287-840f-b96bee18640f-federate-client-tls\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.410679 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.410497 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4bde902-e7fb-4287-840f-b96bee18640f-serving-certs-ca-bundle\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.410679 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.410516 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e4bde902-e7fb-4287-840f-b96bee18640f-telemeter-client-tls\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.410679 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.410545 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4bde902-e7fb-4287-840f-b96bee18640f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.410997 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.410956 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pjjk\" (UniqueName: \"kubernetes.io/projected/e4bde902-e7fb-4287-840f-b96bee18640f-kube-api-access-7pjjk\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.411139 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.411030 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4bde902-e7fb-4287-840f-b96bee18640f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.411139 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.411074 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e4bde902-e7fb-4287-840f-b96bee18640f-secret-telemeter-client\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.411298 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.411243 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4bde902-e7fb-4287-840f-b96bee18640f-metrics-client-ca\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.411663 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.411641 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4bde902-e7fb-4287-840f-b96bee18640f-serving-certs-ca-bundle\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.412012 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.411991 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4bde902-e7fb-4287-840f-b96bee18640f-metrics-client-ca\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.412066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.412022 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4bde902-e7fb-4287-840f-b96bee18640f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.413560 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.413537 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e4bde902-e7fb-4287-840f-b96bee18640f-secret-telemeter-client\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.413649 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.413592 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4bde902-e7fb-4287-840f-b96bee18640f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.413834 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.413812 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e4bde902-e7fb-4287-840f-b96bee18640f-telemeter-client-tls\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.414337 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.414307 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e4bde902-e7fb-4287-840f-b96bee18640f-federate-client-tls\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.429215 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.429183 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pjjk\" (UniqueName: \"kubernetes.io/projected/e4bde902-e7fb-4287-840f-b96bee18640f-kube-api-access-7pjjk\") pod \"telemeter-client-54f7b898c9-jdsg4\" (UID: \"e4bde902-e7fb-4287-840f-b96bee18640f\") " pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.539767 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:04:13.539697 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fcfd64b_c504_4e26_9221_23ceb7c65a5a.slice/crio-1354f9f586e8e3e0329826036fb1fd1d184ec29767869d4469de169ff47fa350 WatchSource:0}: Error finding container 1354f9f586e8e3e0329826036fb1fd1d184ec29767869d4469de169ff47fa350: Status 404 returned error can't find the container with id 1354f9f586e8e3e0329826036fb1fd1d184ec29767869d4469de169ff47fa350 Jul 08 12:04:13.585290 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.585255 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" Jul 08 12:04:13.700569 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.700541 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vcls6" event={"ID":"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf","Type":"ContainerStarted","Data":"c5b87c601dd0ed754326b3e43e9b2d6671be096540d7f5680d7dc907cc3aaadf"} Jul 08 12:04:13.702365 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.702336 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78d858979-wrqzz" event={"ID":"5fcfd64b-c504-4e26-9221-23ceb7c65a5a","Type":"ContainerStarted","Data":"1354f9f586e8e3e0329826036fb1fd1d184ec29767869d4469de169ff47fa350"} Jul 08 12:04:13.743301 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:13.743196 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-54f7b898c9-jdsg4"] Jul 08 12:04:14.563023 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:14.562967 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:14.710062 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:14.710026 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vcls6" event={"ID":"785fe3cf-57e7-4673-b7a8-8e40ec6d68bf","Type":"ContainerStarted","Data":"8549b05e103331431b1b626658e4eb09182379da37a186b6ee1bf2a8a8a24496"} Jul 08 12:04:14.710508 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:14.710123 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vcls6" Jul 08 12:04:14.716205 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:14.716178 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" event={"ID":"e4bde902-e7fb-4287-840f-b96bee18640f","Type":"ContainerStarted","Data":"57744f4a1b618848ec8a7727c432dcaa8c77ec63b1f53800679ee47da2a66181"} Jul 08 12:04:14.733720 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:14.733662 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vcls6" podStartSLOduration=129.758792314 podStartE2EDuration="2m11.733643763s" totalImagesPullingTime="1.974851449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:04:14.732958072 +0000 UTC m=+166.092697383" watchObservedRunningTime="2026-07-08 12:04:14.733643763 +0000 UTC m=+166.093383121" Jul 08 12:04:14.819795 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:14.819706 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:14.916981 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:14.916943 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:16.248600 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.248527 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f95f45b8f-5qdqk"] Jul 08 12:04:16.249002 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.248848 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:04:16.272663 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.272638 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:04:16.340939 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.340895 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls\") pod \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " Jul 08 12:04:16.341091 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.340963 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4q4vt\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-kube-api-access-4q4vt\") pod \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " Jul 08 12:04:16.341091 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.340994 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-trusted-ca\") pod \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " Jul 08 12:04:16.341091 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.341040 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-image-registry-private-configuration\") pod \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " Jul 08 12:04:16.341091 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.341070 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-installation-pull-secrets\") pod \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " Jul 08 12:04:16.341300 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.341129 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-bound-sa-token\") pod \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " Jul 08 12:04:16.341300 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.341177 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-ca-trust-extracted\") pod \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " Jul 08 12:04:16.341300 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.341217 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-certificates\") pod \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\" (UID: \"ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c\") " Jul 08 12:04:16.341800 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.341734 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c" (UID: "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 12:04:16.341991 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.341875 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c" (UID: "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:04:16.342367 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.342325 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c" (UID: "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 12:04:16.343699 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.343661 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c" (UID: "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:04:16.344396 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.344369 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-kube-api-access-4q4vt" (OuterVolumeSpecName: "kube-api-access-4q4vt") pod "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c" (UID: "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c"). InnerVolumeSpecName "kube-api-access-4q4vt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:04:16.344644 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.344393 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c" (UID: "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 12:04:16.344644 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.344488 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c" (UID: "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 12:04:16.344772 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.344755 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c" (UID: "ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:04:16.350245 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.350217 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:16.442955 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.442924 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-image-registry-private-configuration\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:04:16.442955 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.442956 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-installation-pull-secrets\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:04:16.443221 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.442972 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-bound-sa-token\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:04:16.443221 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.442987 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-ca-trust-extracted\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:04:16.443221 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.443001 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-certificates\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:04:16.443221 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.443015 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-registry-tls\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:04:16.443221 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.443029 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4q4vt\" (UniqueName: \"kubernetes.io/projected/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-kube-api-access-4q4vt\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:04:16.443221 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.443041 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c-trusted-ca\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:04:16.447951 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.447904 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:16.642773 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.642684 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:16.727474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.727440 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" event={"ID":"0e9ad891-b318-43af-b261-7ac068d135e2","Type":"ContainerStarted","Data":"6e7be575ff407b437c77469b647600b00467343677f946ec3f4deea632eac84a"} Jul 08 12:04:16.727634 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.727507 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" event={"ID":"0e9ad891-b318-43af-b261-7ac068d135e2","Type":"ContainerStarted","Data":"bddd9ae4a550172b6337a44946513be5ec79d5f25d9698748c9621ee2aedfe18"} Jul 08 12:04:16.727634 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.727532 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" event={"ID":"0e9ad891-b318-43af-b261-7ac068d135e2","Type":"ContainerStarted","Data":"ab989f96587c0b0d241c5c79d15bb5f87b635ed86b23ecc2245189d69eb889b6"} Jul 08 12:04:16.729159 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.729129 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78d858979-wrqzz" event={"ID":"5fcfd64b-c504-4e26-9221-23ceb7c65a5a","Type":"ContainerStarted","Data":"821925f01517643a5b2029a1079642ce24e84ce27dcd012ebd70aaee9ae0de57"} Jul 08 12:04:16.730776 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.730760 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f95f45b8f-5qdqk" Jul 08 12:04:16.730853 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.730793 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" event={"ID":"e4bde902-e7fb-4287-840f-b96bee18640f","Type":"ContainerStarted","Data":"41c7799719a826136b5d4419f23e52675e69b7c18732404336f544a6863bbe76"} Jul 08 12:04:16.751037 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.750992 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-78d858979-wrqzz" podStartSLOduration=2.167990002 podStartE2EDuration="4.750977533s" totalImagesPullingTime="2.582987531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:04:16.749692389 +0000 UTC m=+168.109431694" watchObservedRunningTime="2026-07-08 12:04:16.750977533 +0000 UTC m=+168.110716839" Jul 08 12:04:16.785489 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.785450 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f95f45b8f-5qdqk"] Jul 08 12:04:16.791252 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.791223 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f95f45b8f-5qdqk"] Jul 08 12:04:16.956497 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.956395 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65b76c7487-ftlz7"] Jul 08 12:04:16.968589 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.968065 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:16.969716 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.969689 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65b76c7487-ftlz7"] Jul 08 12:04:16.971676 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.971644 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 12:04:16.971799 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.971713 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 12:04:16.971799 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.971745 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 12:04:16.971799 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.971788 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 12:04:16.972032 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.971652 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 12:04:16.972232 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.972215 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 12:04:16.972321 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.972235 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-km99f\"" Jul 08 12:04:16.972463 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:16.972447 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 12:04:17.049882 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.049752 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0c0a9a5-969c-4df8-9af1-b9532d819476-console-serving-cert\") pod \"console-65b76c7487-ftlz7\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:17.049882 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.049834 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl9dd\" (UniqueName: \"kubernetes.io/projected/b0c0a9a5-969c-4df8-9af1-b9532d819476-kube-api-access-xl9dd\") pod \"console-65b76c7487-ftlz7\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:17.049882 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.049884 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0c0a9a5-969c-4df8-9af1-b9532d819476-console-config\") pod \"console-65b76c7487-ftlz7\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:17.050173 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.049903 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0c0a9a5-969c-4df8-9af1-b9532d819476-oauth-serving-cert\") pod \"console-65b76c7487-ftlz7\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:17.050173 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.049974 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c0a9a5-969c-4df8-9af1-b9532d819476-service-ca\") pod \"console-65b76c7487-ftlz7\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:17.050173 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.050022 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0c0a9a5-969c-4df8-9af1-b9532d819476-console-oauth-config\") pod \"console-65b76c7487-ftlz7\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:17.133338 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.133300 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c" path="/var/lib/kubelet/pods/ca1d1bab-ab74-4152-84a0-0f1c6f0cc54c/volumes" Jul 08 12:04:17.150753 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.150726 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c0a9a5-969c-4df8-9af1-b9532d819476-service-ca\") pod \"console-65b76c7487-ftlz7\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:17.150874 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.150787 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0c0a9a5-969c-4df8-9af1-b9532d819476-console-oauth-config\") pod \"console-65b76c7487-ftlz7\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:17.150874 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.150845 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0c0a9a5-969c-4df8-9af1-b9532d819476-console-serving-cert\") pod \"console-65b76c7487-ftlz7\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:17.151001 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.150890 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl9dd\" (UniqueName: \"kubernetes.io/projected/b0c0a9a5-969c-4df8-9af1-b9532d819476-kube-api-access-xl9dd\") pod \"console-65b76c7487-ftlz7\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:17.151001 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.150937 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0c0a9a5-969c-4df8-9af1-b9532d819476-console-config\") pod \"console-65b76c7487-ftlz7\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:17.151001 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.150965 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0c0a9a5-969c-4df8-9af1-b9532d819476-oauth-serving-cert\") pod \"console-65b76c7487-ftlz7\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:17.151588 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.151530 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c0a9a5-969c-4df8-9af1-b9532d819476-service-ca\") pod \"console-65b76c7487-ftlz7\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:17.151696 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.151617 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0c0a9a5-969c-4df8-9af1-b9532d819476-oauth-serving-cert\") pod \"console-65b76c7487-ftlz7\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:17.151863 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.151844 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0c0a9a5-969c-4df8-9af1-b9532d819476-console-config\") pod \"console-65b76c7487-ftlz7\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:17.153633 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.153613 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0c0a9a5-969c-4df8-9af1-b9532d819476-console-serving-cert\") pod \"console-65b76c7487-ftlz7\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:17.153739 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.153716 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0c0a9a5-969c-4df8-9af1-b9532d819476-console-oauth-config\") pod \"console-65b76c7487-ftlz7\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:17.161313 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.161283 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl9dd\" (UniqueName: \"kubernetes.io/projected/b0c0a9a5-969c-4df8-9af1-b9532d819476-kube-api-access-xl9dd\") pod \"console-65b76c7487-ftlz7\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:17.282265 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:17.282234 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:18.142293 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:18.142218 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65b76c7487-ftlz7"] Jul 08 12:04:18.144717 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:04:18.144695 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c0a9a5_969c_4df8_9af1_b9532d819476.slice/crio-091250bf3a4d65c3808ca6117c23089f03ae389ad7e0e046482e0f71ef6d9f7a WatchSource:0}: Error finding container 091250bf3a4d65c3808ca6117c23089f03ae389ad7e0e046482e0f71ef6d9f7a: Status 404 returned error can't find the container with id 091250bf3a4d65c3808ca6117c23089f03ae389ad7e0e046482e0f71ef6d9f7a Jul 08 12:04:18.741353 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:18.741320 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" event={"ID":"0e9ad891-b318-43af-b261-7ac068d135e2","Type":"ContainerStarted","Data":"fb1236f1a2fa4dc0516793e33c33b2d401120666eace1ddfd45df001d01ff91b"} Jul 08 12:04:18.741770 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:18.741392 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" event={"ID":"0e9ad891-b318-43af-b261-7ac068d135e2","Type":"ContainerStarted","Data":"a43793880fa2ef6e7d489f5edea1901c13771bd7dc0e428194f5c4befc16f1cc"} Jul 08 12:04:18.741770 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:18.741431 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" event={"ID":"0e9ad891-b318-43af-b261-7ac068d135e2","Type":"ContainerStarted","Data":"749be42c0d9e948229b58a151b67beb94b379c94be22abb495211cc1863ede98"} Jul 08 12:04:18.741770 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:18.741485 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:18.743302 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:18.743273 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" event={"ID":"e4bde902-e7fb-4287-840f-b96bee18640f","Type":"ContainerStarted","Data":"2e2279afb8465da07fb8eeee8c2b7f2befca56fa0f8cb1bee7499deab5e60329"} Jul 08 12:04:18.743438 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:18.743326 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" event={"ID":"e4bde902-e7fb-4287-840f-b96bee18640f","Type":"ContainerStarted","Data":"d378747f6da022832a944f228068c967055215ca1c29656125fc32aa2fa59407"} Jul 08 12:04:18.744402 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:18.744384 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65b76c7487-ftlz7" event={"ID":"b0c0a9a5-969c-4df8-9af1-b9532d819476","Type":"ContainerStarted","Data":"091250bf3a4d65c3808ca6117c23089f03ae389ad7e0e046482e0f71ef6d9f7a"} Jul 08 12:04:18.771881 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:18.771347 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" podStartSLOduration=1.842744031 podStartE2EDuration="7.771328028s" totalImagesPullingTime="5.928583997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:04:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:04:18.770246373 +0000 UTC m=+170.129985681" watchObservedRunningTime="2026-07-08 12:04:18.771328028 +0000 UTC m=+170.131067336" Jul 08 12:04:18.793822 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:18.793778 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-54f7b898c9-jdsg4" podStartSLOduration=1.649283084 podStartE2EDuration="5.793764005s" totalImagesPullingTime="4.144480921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:04:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:04:18.792794103 +0000 UTC m=+170.152533410" watchObservedRunningTime="2026-07-08 12:04:18.793764005 +0000 UTC m=+170.153503311" Jul 08 12:04:19.130124 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:19.130089 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:04:20.547355 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:20.547319 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:20.644900 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:20.644865 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:21.759284 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:21.759197 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65b76c7487-ftlz7" event={"ID":"b0c0a9a5-969c-4df8-9af1-b9532d819476","Type":"ContainerStarted","Data":"eccdbf08061b77f64b1f320398e2d5465d63677fafbaa74b5ff36a6128866f64"} Jul 08 12:04:21.779498 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:21.779450 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65b76c7487-ftlz7" podStartSLOduration=2.626031857 podStartE2EDuration="5.779427568s" totalImagesPullingTime="3.153395711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:04:21.778884901 +0000 UTC m=+173.138624208" watchObservedRunningTime="2026-07-08 12:04:21.779427568 +0000 UTC m=+173.139166853" Jul 08 12:04:22.632660 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:22.632619 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:24.723219 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:24.723186 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vcls6" Jul 08 12:04:24.755753 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:24.755727 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-866d7745cc-5n4vf" Jul 08 12:04:25.566534 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:25.566497 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:25.665514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:25.665483 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:25.849615 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:25.849522 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:27.282779 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:27.282752 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:27.283149 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:27.282803 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:27.287676 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:27.287657 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:27.787014 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:27.786977 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:04:29.204360 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:29.204318 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:29.972183 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:29.972144 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:30.035739 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:30.035707 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:30.748021 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:30.747984 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:30.815753 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:30.815704 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:32.953089 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:32.953046 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:32.953477 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:32.953111 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:33.882249 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:33.882213 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:35.415115 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:35.415077 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65b76c7487-ftlz7"] Jul 08 12:04:35.533199 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:35.533163 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:35.630998 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:35.630963 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:36.175257 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:36.175230 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:36.276786 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:36.276751 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:39.785162 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:39.785121 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:39.889136 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:39.889082 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:39.989050 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:39.989021 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:40.761169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:40.761134 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:40.819898 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:40.819866 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:52.959310 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:52.959275 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:52.963348 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:52.963326 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-78d858979-wrqzz" Jul 08 12:04:55.514053 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:55.514015 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:55.615013 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:55.614949 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:55.716381 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:55.716336 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:04:55.775852 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:04:55.775731 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:05:00.436333 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.436275 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-65b76c7487-ftlz7" podUID="b0c0a9a5-969c-4df8-9af1-b9532d819476" containerName="console" containerID="cri-o://eccdbf08061b77f64b1f320398e2d5465d63677fafbaa74b5ff36a6128866f64" gracePeriod=15 Jul 08 12:05:00.679322 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.679294 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:05:00.722949 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.722850 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0c0a9a5-969c-4df8-9af1-b9532d819476-console-config\") pod \"b0c0a9a5-969c-4df8-9af1-b9532d819476\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " Jul 08 12:05:00.722949 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.722886 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl9dd\" (UniqueName: \"kubernetes.io/projected/b0c0a9a5-969c-4df8-9af1-b9532d819476-kube-api-access-xl9dd\") pod \"b0c0a9a5-969c-4df8-9af1-b9532d819476\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " Jul 08 12:05:00.723154 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.722959 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0c0a9a5-969c-4df8-9af1-b9532d819476-oauth-serving-cert\") pod \"b0c0a9a5-969c-4df8-9af1-b9532d819476\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " Jul 08 12:05:00.723154 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.723003 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0c0a9a5-969c-4df8-9af1-b9532d819476-console-oauth-config\") pod \"b0c0a9a5-969c-4df8-9af1-b9532d819476\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " Jul 08 12:05:00.723154 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.723031 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c0a9a5-969c-4df8-9af1-b9532d819476-service-ca\") pod \"b0c0a9a5-969c-4df8-9af1-b9532d819476\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " Jul 08 12:05:00.723154 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.723083 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0c0a9a5-969c-4df8-9af1-b9532d819476-console-serving-cert\") pod \"b0c0a9a5-969c-4df8-9af1-b9532d819476\" (UID: \"b0c0a9a5-969c-4df8-9af1-b9532d819476\") " Jul 08 12:05:00.723369 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.723311 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0c0a9a5-969c-4df8-9af1-b9532d819476-console-config" (OuterVolumeSpecName: "console-config") pod "b0c0a9a5-969c-4df8-9af1-b9532d819476" (UID: "b0c0a9a5-969c-4df8-9af1-b9532d819476"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 12:05:00.723441 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.723404 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0c0a9a5-969c-4df8-9af1-b9532d819476-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b0c0a9a5-969c-4df8-9af1-b9532d819476" (UID: "b0c0a9a5-969c-4df8-9af1-b9532d819476"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 12:05:00.723530 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.723499 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0c0a9a5-969c-4df8-9af1-b9532d819476-service-ca" (OuterVolumeSpecName: "service-ca") pod "b0c0a9a5-969c-4df8-9af1-b9532d819476" (UID: "b0c0a9a5-969c-4df8-9af1-b9532d819476"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 12:05:00.725332 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.725305 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0c0a9a5-969c-4df8-9af1-b9532d819476-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b0c0a9a5-969c-4df8-9af1-b9532d819476" (UID: "b0c0a9a5-969c-4df8-9af1-b9532d819476"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 12:05:00.725332 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.725316 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0c0a9a5-969c-4df8-9af1-b9532d819476-kube-api-access-xl9dd" (OuterVolumeSpecName: "kube-api-access-xl9dd") pod "b0c0a9a5-969c-4df8-9af1-b9532d819476" (UID: "b0c0a9a5-969c-4df8-9af1-b9532d819476"). InnerVolumeSpecName "kube-api-access-xl9dd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:05:00.725447 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.725326 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0c0a9a5-969c-4df8-9af1-b9532d819476-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b0c0a9a5-969c-4df8-9af1-b9532d819476" (UID: "b0c0a9a5-969c-4df8-9af1-b9532d819476"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 12:05:00.824748 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.824711 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl9dd\" (UniqueName: \"kubernetes.io/projected/b0c0a9a5-969c-4df8-9af1-b9532d819476-kube-api-access-xl9dd\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:05:00.824748 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.824744 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0c0a9a5-969c-4df8-9af1-b9532d819476-oauth-serving-cert\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:05:00.824989 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.824757 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0c0a9a5-969c-4df8-9af1-b9532d819476-console-oauth-config\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:05:00.824989 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.824771 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c0a9a5-969c-4df8-9af1-b9532d819476-service-ca\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:05:00.824989 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.824782 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0c0a9a5-969c-4df8-9af1-b9532d819476-console-serving-cert\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:05:00.824989 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.824793 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0c0a9a5-969c-4df8-9af1-b9532d819476-console-config\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:05:00.904268 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.904233 2560 generic.go:356] "Generic (PLEG): container finished" podID="b0c0a9a5-969c-4df8-9af1-b9532d819476" containerID="eccdbf08061b77f64b1f320398e2d5465d63677fafbaa74b5ff36a6128866f64" exitCode=0 Jul 08 12:05:00.904438 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.904274 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65b76c7487-ftlz7" Jul 08 12:05:00.904438 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.904290 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65b76c7487-ftlz7" event={"ID":"b0c0a9a5-969c-4df8-9af1-b9532d819476","Type":"ContainerDied","Data":"eccdbf08061b77f64b1f320398e2d5465d63677fafbaa74b5ff36a6128866f64"} Jul 08 12:05:00.904438 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.904341 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65b76c7487-ftlz7" event={"ID":"b0c0a9a5-969c-4df8-9af1-b9532d819476","Type":"ContainerDied","Data":"091250bf3a4d65c3808ca6117c23089f03ae389ad7e0e046482e0f71ef6d9f7a"} Jul 08 12:05:00.904438 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.904367 2560 scope.go:117] "RemoveContainer" containerID="eccdbf08061b77f64b1f320398e2d5465d63677fafbaa74b5ff36a6128866f64" Jul 08 12:05:00.913537 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.913520 2560 scope.go:117] "RemoveContainer" containerID="eccdbf08061b77f64b1f320398e2d5465d63677fafbaa74b5ff36a6128866f64" Jul 08 12:05:00.913775 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:05:00.913758 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eccdbf08061b77f64b1f320398e2d5465d63677fafbaa74b5ff36a6128866f64\": container with ID starting with eccdbf08061b77f64b1f320398e2d5465d63677fafbaa74b5ff36a6128866f64 not found: ID does not exist" containerID="eccdbf08061b77f64b1f320398e2d5465d63677fafbaa74b5ff36a6128866f64" Jul 08 12:05:00.913836 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.913780 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eccdbf08061b77f64b1f320398e2d5465d63677fafbaa74b5ff36a6128866f64"} err="failed to get container status \"eccdbf08061b77f64b1f320398e2d5465d63677fafbaa74b5ff36a6128866f64\": rpc error: code = NotFound desc = could not find container \"eccdbf08061b77f64b1f320398e2d5465d63677fafbaa74b5ff36a6128866f64\": container with ID starting with eccdbf08061b77f64b1f320398e2d5465d63677fafbaa74b5ff36a6128866f64 not found: ID does not exist" Jul 08 12:05:00.927336 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.927312 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65b76c7487-ftlz7"] Jul 08 12:05:00.931610 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:00.931588 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65b76c7487-ftlz7"] Jul 08 12:05:01.131321 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:01.131291 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0c0a9a5-969c-4df8-9af1-b9532d819476" path="/var/lib/kubelet/pods/b0c0a9a5-969c-4df8-9af1-b9532d819476/volumes" Jul 08 12:05:24.391678 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:24.391640 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:05:24.481520 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:24.481483 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:05:31.298849 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.298811 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-89794f788-rfm65"] Jul 08 12:05:31.299331 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.299274 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c0a9a5-969c-4df8-9af1-b9532d819476" containerName="console" Jul 08 12:05:31.299331 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.299290 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c0a9a5-969c-4df8-9af1-b9532d819476" containerName="console" Jul 08 12:05:31.299449 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.299360 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0c0a9a5-969c-4df8-9af1-b9532d819476" containerName="console" Jul 08 12:05:31.303638 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.303617 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.306477 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.306453 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 12:05:31.306617 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.306538 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 12:05:31.307820 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.307799 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 12:05:31.308029 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.307833 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 12:05:31.308112 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.308056 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 12:05:31.308181 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.307935 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 12:05:31.308287 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.308263 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 12:05:31.308393 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.308375 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-km99f\"" Jul 08 12:05:31.316480 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.316450 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 12:05:31.316802 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.316777 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-89794f788-rfm65"] Jul 08 12:05:31.356980 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.356937 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:05:31.389892 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.389859 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st7fv\" (UniqueName: \"kubernetes.io/projected/8c475865-8b38-43f7-8a04-7d131f351faa-kube-api-access-st7fv\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.389892 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.389901 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-oauth-serving-cert\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.390126 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.389950 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c475865-8b38-43f7-8a04-7d131f351faa-console-oauth-config\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.390126 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.389965 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-service-ca\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.390126 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.389982 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-trusted-ca-bundle\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.390126 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.390071 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c475865-8b38-43f7-8a04-7d131f351faa-console-serving-cert\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.390126 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.390117 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-console-config\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.491045 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.491011 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st7fv\" (UniqueName: \"kubernetes.io/projected/8c475865-8b38-43f7-8a04-7d131f351faa-kube-api-access-st7fv\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.491045 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.491051 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-oauth-serving-cert\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.491283 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.491263 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c475865-8b38-43f7-8a04-7d131f351faa-console-oauth-config\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.491319 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.491302 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-service-ca\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.491368 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.491328 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-trusted-ca-bundle\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.491432 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.491400 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c475865-8b38-43f7-8a04-7d131f351faa-console-serving-cert\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.491485 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.491439 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-console-config\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.491892 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.491851 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-oauth-serving-cert\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.492028 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.491972 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-service-ca\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.492126 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.492110 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-console-config\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.492305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.492284 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-trusted-ca-bundle\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.493747 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.493726 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c475865-8b38-43f7-8a04-7d131f351faa-console-oauth-config\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.493864 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.493848 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c475865-8b38-43f7-8a04-7d131f351faa-console-serving-cert\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.501044 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.501023 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st7fv\" (UniqueName: \"kubernetes.io/projected/8c475865-8b38-43f7-8a04-7d131f351faa-kube-api-access-st7fv\") pod \"console-89794f788-rfm65\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.614978 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.614875 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:31.746374 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:31.746281 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-89794f788-rfm65"] Jul 08 12:05:31.748637 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:05:31.748612 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c475865_8b38_43f7_8a04_7d131f351faa.slice/crio-e5023c128611720e47eb7d1e32f8d6f737fff7806a2d12397ed4ef35d3d62da9 WatchSource:0}: Error finding container e5023c128611720e47eb7d1e32f8d6f737fff7806a2d12397ed4ef35d3d62da9: Status 404 returned error can't find the container with id e5023c128611720e47eb7d1e32f8d6f737fff7806a2d12397ed4ef35d3d62da9 Jul 08 12:05:32.021041 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:32.021005 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89794f788-rfm65" event={"ID":"8c475865-8b38-43f7-8a04-7d131f351faa","Type":"ContainerStarted","Data":"69ebc635c1fac8ebd97e1fac4a583ecbefb61d5d3346d8f80257d9f7617f98eb"} Jul 08 12:05:32.021209 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:32.021053 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89794f788-rfm65" event={"ID":"8c475865-8b38-43f7-8a04-7d131f351faa","Type":"ContainerStarted","Data":"e5023c128611720e47eb7d1e32f8d6f737fff7806a2d12397ed4ef35d3d62da9"} Jul 08 12:05:32.041048 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:32.040997 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-89794f788-rfm65" podStartSLOduration=1.040980593 podStartE2EDuration="1.040980593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:05:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:05:32.04024515 +0000 UTC m=+243.399984458" watchObservedRunningTime="2026-07-08 12:05:32.040980593 +0000 UTC m=+243.400719899" Jul 08 12:05:36.334902 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:36.334866 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:05:36.450089 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:36.450058 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:05:40.105297 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:40.105261 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:05:40.162159 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:40.162117 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs\") pod \"network-metrics-daemon-hpnpx\" (UID: \"129e9e1b-586a-4226-be04-0544c26f0d9d\") " pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:05:40.164455 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:40.164432 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/129e9e1b-586a-4226-be04-0544c26f0d9d-metrics-certs\") pod \"network-metrics-daemon-hpnpx\" (UID: \"129e9e1b-586a-4226-be04-0544c26f0d9d\") " pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:05:40.433931 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:40.433829 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rdkjt\"" Jul 08 12:05:40.441062 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:40.441042 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hpnpx" Jul 08 12:05:40.567871 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:40.567837 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hpnpx"] Jul 08 12:05:40.570680 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:05:40.570650 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod129e9e1b_586a_4226_be04_0544c26f0d9d.slice/crio-d8ba8feb22462d32b07fb04f86445b87d19987f87092530f4b22aa3451c4af21 WatchSource:0}: Error finding container d8ba8feb22462d32b07fb04f86445b87d19987f87092530f4b22aa3451c4af21: Status 404 returned error can't find the container with id d8ba8feb22462d32b07fb04f86445b87d19987f87092530f4b22aa3451c4af21 Jul 08 12:05:40.698841 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:40.698754 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:05:40.801024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:40.800991 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:05:40.898182 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:40.898147 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:05:41.058324 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:41.058289 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hpnpx" event={"ID":"129e9e1b-586a-4226-be04-0544c26f0d9d","Type":"ContainerStarted","Data":"d8ba8feb22462d32b07fb04f86445b87d19987f87092530f4b22aa3451c4af21"} Jul 08 12:05:41.615764 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:41.615726 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:41.616245 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:41.615802 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:41.621372 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:41.621350 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:42.063630 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:42.063596 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hpnpx" event={"ID":"129e9e1b-586a-4226-be04-0544c26f0d9d","Type":"ContainerStarted","Data":"2e1ddecbdbe7c892973f4d6811d502d3693675426d0c3fdffd91da5f9b467377"} Jul 08 12:05:42.063819 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:42.063675 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hpnpx" event={"ID":"129e9e1b-586a-4226-be04-0544c26f0d9d","Type":"ContainerStarted","Data":"ed7252bebd9d23481bc412e45b4a2930982bd542991e7270c957baa890bbfcd9"} Jul 08 12:05:42.067506 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:42.067482 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-89794f788-rfm65" Jul 08 12:05:42.083839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:42.083781 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hpnpx" podStartSLOduration=251.876388676 podStartE2EDuration="4m13.083764197s" totalImagesPullingTime="1.207375521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:05:42.081868011 +0000 UTC m=+253.441607318" watchObservedRunningTime="2026-07-08 12:05:42.083764197 +0000 UTC m=+253.443503519" Jul 08 12:05:42.212075 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:42.211983 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:05:42.311368 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:42.311336 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:05:42.410055 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:42.410022 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:05:46.823573 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:46.823532 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:05:46.902649 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:05:46.902606 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:12.194457 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:12.194423 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:12.292903 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:12.292869 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:13.936858 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:13.936825 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj"] Jul 08 12:06:13.940350 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:13.940332 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" Jul 08 12:06:13.943228 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:13.943202 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ngf7m\"" Jul 08 12:06:13.943372 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:13.943232 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 12:06:13.944390 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:13.944370 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 12:06:13.951479 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:13.951456 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj"] Jul 08 12:06:14.043897 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:14.043867 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj\" (UID: \"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" Jul 08 12:06:14.044116 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:14.043927 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj\" (UID: \"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" Jul 08 12:06:14.044116 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:14.044015 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcv8g\" (UniqueName: \"kubernetes.io/projected/d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa-kube-api-access-rcv8g\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj\" (UID: \"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" Jul 08 12:06:14.144749 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:14.144711 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcv8g\" (UniqueName: \"kubernetes.io/projected/d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa-kube-api-access-rcv8g\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj\" (UID: \"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" Jul 08 12:06:14.145000 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:14.144775 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj\" (UID: \"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" Jul 08 12:06:14.145000 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:14.144794 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj\" (UID: \"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" Jul 08 12:06:14.145175 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:14.145158 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj\" (UID: \"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" Jul 08 12:06:14.145212 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:14.145186 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj\" (UID: \"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" Jul 08 12:06:14.154694 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:14.154663 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcv8g\" (UniqueName: \"kubernetes.io/projected/d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa-kube-api-access-rcv8g\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj\" (UID: \"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" Jul 08 12:06:14.249642 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:14.249565 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" Jul 08 12:06:14.382345 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:14.382323 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj"] Jul 08 12:06:14.384250 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:06:14.384224 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3c5a107_721f_4a5a_9b8d_ecb6b10e54aa.slice/crio-0bff737a8d0e898cafa8c9db6d00083847754b6198051fe23915ec8e5be38239 WatchSource:0}: Error finding container 0bff737a8d0e898cafa8c9db6d00083847754b6198051fe23915ec8e5be38239: Status 404 returned error can't find the container with id 0bff737a8d0e898cafa8c9db6d00083847754b6198051fe23915ec8e5be38239 Jul 08 12:06:15.194995 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:15.194950 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" event={"ID":"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa","Type":"ContainerStarted","Data":"0bff737a8d0e898cafa8c9db6d00083847754b6198051fe23915ec8e5be38239"} Jul 08 12:06:23.232067 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:23.232029 2560 generic.go:356] "Generic (PLEG): container finished" podID="d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa" containerID="d4b9007c18159c044d7105aac736d3371b6e66a07a041a43fc2a8c73565ab268" exitCode=0 Jul 08 12:06:23.232518 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:23.232109 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" event={"ID":"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa","Type":"ContainerDied","Data":"d4b9007c18159c044d7105aac736d3371b6e66a07a041a43fc2a8c73565ab268"} Jul 08 12:06:28.253324 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.253287 2560 generic.go:356] "Generic (PLEG): container finished" podID="d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa" containerID="041bf0377528efe6fd73965f07f3702657a0951edf77fa82978b6eda5fe4c721" exitCode=0 Jul 08 12:06:28.253733 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.253369 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" event={"ID":"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa","Type":"ContainerDied","Data":"041bf0377528efe6fd73965f07f3702657a0951edf77fa82978b6eda5fe4c721"} Jul 08 12:06:28.614266 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.614233 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:28.663082 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.663045 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b"] Jul 08 12:06:28.666458 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.666441 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.669371 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.669340 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/38834259-4089-4050-b8e5-4fc4f7efb450-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-557f969f5-kzk5b\" (UID: \"38834259-4089-4050-b8e5-4fc4f7efb450\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.669495 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.669380 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkfzz\" (UniqueName: \"kubernetes.io/projected/38834259-4089-4050-b8e5-4fc4f7efb450-kube-api-access-xkfzz\") pod \"cluster-proxy-proxy-agent-557f969f5-kzk5b\" (UID: \"38834259-4089-4050-b8e5-4fc4f7efb450\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.669495 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.669435 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/38834259-4089-4050-b8e5-4fc4f7efb450-ca\") pod \"cluster-proxy-proxy-agent-557f969f5-kzk5b\" (UID: \"38834259-4089-4050-b8e5-4fc4f7efb450\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.669495 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.669466 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/38834259-4089-4050-b8e5-4fc4f7efb450-additional-service-ca\") pod \"cluster-proxy-proxy-agent-557f969f5-kzk5b\" (UID: \"38834259-4089-4050-b8e5-4fc4f7efb450\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.669611 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.669530 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/38834259-4089-4050-b8e5-4fc4f7efb450-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-557f969f5-kzk5b\" (UID: \"38834259-4089-4050-b8e5-4fc4f7efb450\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.669611 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.669578 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/38834259-4089-4050-b8e5-4fc4f7efb450-hub\") pod \"cluster-proxy-proxy-agent-557f969f5-kzk5b\" (UID: \"38834259-4089-4050-b8e5-4fc4f7efb450\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.670720 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.670699 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 08 12:06:28.670952 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.670934 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 08 12:06:28.671077 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.670953 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 08 12:06:28.671993 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.671965 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 08 12:06:28.671993 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.671983 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 08 12:06:28.672143 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.672005 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 08 12:06:28.672143 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.671981 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 08 12:06:28.682989 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.682967 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b"] Jul 08 12:06:28.724335 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.724295 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:28.770519 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.770474 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/38834259-4089-4050-b8e5-4fc4f7efb450-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-557f969f5-kzk5b\" (UID: \"38834259-4089-4050-b8e5-4fc4f7efb450\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.770519 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.770524 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/38834259-4089-4050-b8e5-4fc4f7efb450-hub\") pod \"cluster-proxy-proxy-agent-557f969f5-kzk5b\" (UID: \"38834259-4089-4050-b8e5-4fc4f7efb450\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.770774 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.770549 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/38834259-4089-4050-b8e5-4fc4f7efb450-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-557f969f5-kzk5b\" (UID: \"38834259-4089-4050-b8e5-4fc4f7efb450\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.770774 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.770566 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkfzz\" (UniqueName: \"kubernetes.io/projected/38834259-4089-4050-b8e5-4fc4f7efb450-kube-api-access-xkfzz\") pod \"cluster-proxy-proxy-agent-557f969f5-kzk5b\" (UID: \"38834259-4089-4050-b8e5-4fc4f7efb450\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.770774 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.770611 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/38834259-4089-4050-b8e5-4fc4f7efb450-ca\") pod \"cluster-proxy-proxy-agent-557f969f5-kzk5b\" (UID: \"38834259-4089-4050-b8e5-4fc4f7efb450\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.770774 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.770649 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/38834259-4089-4050-b8e5-4fc4f7efb450-additional-service-ca\") pod \"cluster-proxy-proxy-agent-557f969f5-kzk5b\" (UID: \"38834259-4089-4050-b8e5-4fc4f7efb450\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.771427 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.771398 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/38834259-4089-4050-b8e5-4fc4f7efb450-additional-service-ca\") pod \"cluster-proxy-proxy-agent-557f969f5-kzk5b\" (UID: \"38834259-4089-4050-b8e5-4fc4f7efb450\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.773261 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.773230 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/38834259-4089-4050-b8e5-4fc4f7efb450-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-557f969f5-kzk5b\" (UID: \"38834259-4089-4050-b8e5-4fc4f7efb450\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.773350 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.773303 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/38834259-4089-4050-b8e5-4fc4f7efb450-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-557f969f5-kzk5b\" (UID: \"38834259-4089-4050-b8e5-4fc4f7efb450\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.773422 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.773344 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/38834259-4089-4050-b8e5-4fc4f7efb450-ca\") pod \"cluster-proxy-proxy-agent-557f969f5-kzk5b\" (UID: \"38834259-4089-4050-b8e5-4fc4f7efb450\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.773422 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.773366 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/38834259-4089-4050-b8e5-4fc4f7efb450-hub\") pod \"cluster-proxy-proxy-agent-557f969f5-kzk5b\" (UID: \"38834259-4089-4050-b8e5-4fc4f7efb450\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.785539 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.785513 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkfzz\" (UniqueName: \"kubernetes.io/projected/38834259-4089-4050-b8e5-4fc4f7efb450-kube-api-access-xkfzz\") pod \"cluster-proxy-proxy-agent-557f969f5-kzk5b\" (UID: \"38834259-4089-4050-b8e5-4fc4f7efb450\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:28.814492 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.814455 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:28.988481 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:28.988405 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" Jul 08 12:06:29.098384 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:29.098358 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:06:29.102860 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:29.102830 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:06:29.118468 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:29.118440 2560 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 12:06:29.155133 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:29.155099 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b"] Jul 08 12:06:29.158662 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:06:29.158626 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38834259_4089_4050_b8e5_4fc4f7efb450.slice/crio-01b7cd15f0bf77be0739d0b8599815760d117009d1f8d2f55fd8ef1f459cd40a WatchSource:0}: Error finding container 01b7cd15f0bf77be0739d0b8599815760d117009d1f8d2f55fd8ef1f459cd40a: Status 404 returned error can't find the container with id 01b7cd15f0bf77be0739d0b8599815760d117009d1f8d2f55fd8ef1f459cd40a Jul 08 12:06:29.259036 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:29.258950 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" event={"ID":"38834259-4089-4050-b8e5-4fc4f7efb450","Type":"ContainerStarted","Data":"01b7cd15f0bf77be0739d0b8599815760d117009d1f8d2f55fd8ef1f459cd40a"} Jul 08 12:06:34.285094 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:34.285050 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" event={"ID":"38834259-4089-4050-b8e5-4fc4f7efb450","Type":"ContainerStarted","Data":"ed6990a90996a5626afb8807e6db30e739e72a42d7411ba8ba819cadfaddaceb"} Jul 08 12:06:34.285569 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:34.285103 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" event={"ID":"38834259-4089-4050-b8e5-4fc4f7efb450","Type":"ContainerStarted","Data":"9f1bb95a17b61ef8607821d83288d994fb636a54c23a0dc5e6dc83bf1d6e1bb5"} Jul 08 12:06:34.285569 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:34.285124 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" event={"ID":"38834259-4089-4050-b8e5-4fc4f7efb450","Type":"ContainerStarted","Data":"ca79aecadf9b5fb196fd9eda7d5adc7aa55bb33cc826331799abbfcaf9ab08b9"} Jul 08 12:06:34.316307 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:34.316250 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557f969f5-kzk5b" podStartSLOduration=2.030355456 podStartE2EDuration="6.316235677s" totalImagesPullingTime="4.285880221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:06:34.313796628 +0000 UTC m=+305.673535936" watchObservedRunningTime="2026-07-08 12:06:34.316235677 +0000 UTC m=+305.675974983" Jul 08 12:06:38.303519 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:38.303483 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" event={"ID":"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa","Type":"ContainerStarted","Data":"b3058e4fb2ffe13077a6892e6860c9e6a8ce7a30dc033a735909ae267c374602"} Jul 08 12:06:38.329114 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:38.329065 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" podStartSLOduration=2.873861727 podStartE2EDuration="25.329049552s" totalImagesPullingTime="22.455187825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:06:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:06:38.32761259 +0000 UTC m=+309.687351900" watchObservedRunningTime="2026-07-08 12:06:38.329049552 +0000 UTC m=+309.688788859" Jul 08 12:06:39.309390 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:39.309356 2560 generic.go:356] "Generic (PLEG): container finished" podID="d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa" containerID="b3058e4fb2ffe13077a6892e6860c9e6a8ce7a30dc033a735909ae267c374602" exitCode=0 Jul 08 12:06:39.309851 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:39.309430 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" event={"ID":"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa","Type":"ContainerDied","Data":"b3058e4fb2ffe13077a6892e6860c9e6a8ce7a30dc033a735909ae267c374602"} Jul 08 12:06:39.831009 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:39.830973 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:39.899540 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:39.899506 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:40.499566 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:40.499532 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" Jul 08 12:06:40.584548 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:40.584461 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa-util\") pod \"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa\" (UID: \"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa\") " Jul 08 12:06:40.584548 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:40.584529 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa-bundle\") pod \"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa\" (UID: \"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa\") " Jul 08 12:06:40.584548 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:40.584549 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcv8g\" (UniqueName: \"kubernetes.io/projected/d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa-kube-api-access-rcv8g\") pod \"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa\" (UID: \"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa\") " Jul 08 12:06:40.585218 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:40.585185 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa-bundle" (OuterVolumeSpecName: "bundle") pod "d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa" (UID: "d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:06:40.586758 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:40.586726 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa-kube-api-access-rcv8g" (OuterVolumeSpecName: "kube-api-access-rcv8g") pod "d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa" (UID: "d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa"). InnerVolumeSpecName "kube-api-access-rcv8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:06:40.588929 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:40.588892 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa-util" (OuterVolumeSpecName: "util") pod "d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa" (UID: "d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:06:40.686048 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:40.686007 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa-util\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:06:40.686048 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:40.686040 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa-bundle\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:06:40.686048 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:40.686053 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcv8g\" (UniqueName: \"kubernetes.io/projected/d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa-kube-api-access-rcv8g\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:06:41.319184 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:41.319153 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" Jul 08 12:06:41.319184 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:41.319175 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405kzmj" event={"ID":"d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa","Type":"ContainerDied","Data":"0bff737a8d0e898cafa8c9db6d00083847754b6198051fe23915ec8e5be38239"} Jul 08 12:06:41.319377 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:41.319223 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0bff737a8d0e898cafa8c9db6d00083847754b6198051fe23915ec8e5be38239" Jul 08 12:06:46.291744 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:46.291709 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:46.635226 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:46.635131 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:50.334857 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:50.334818 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:50.436104 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:50.436061 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:52.502675 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:52.502634 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:52.617685 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:52.617653 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:52.705678 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:52.705640 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:52.817254 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:52.817220 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:52.958769 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:52.958734 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64"] Jul 08 12:06:52.959147 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:52.959130 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa" containerName="pull" Jul 08 12:06:52.959232 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:52.959151 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa" containerName="pull" Jul 08 12:06:52.959232 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:52.959161 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa" containerName="extract" Jul 08 12:06:52.959232 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:52.959169 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa" containerName="extract" Jul 08 12:06:52.959232 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:52.959185 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa" containerName="util" Jul 08 12:06:52.959232 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:52.959194 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa" containerName="util" Jul 08 12:06:52.959486 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:52.959298 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3c5a107-721f-4a5a-9b8d-ecb6b10e54aa" containerName="extract" Jul 08 12:06:52.962559 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:52.962536 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" Jul 08 12:06:52.966087 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:52.966063 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 12:06:52.966087 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:52.966074 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 12:06:52.967098 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:52.967080 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ngf7m\"" Jul 08 12:06:52.992859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:52.992822 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64"] Jul 08 12:06:53.095069 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:53.094974 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25zh5\" (UniqueName: \"kubernetes.io/projected/15375d1d-d31e-454c-a20f-1cf285b924fa-kube-api-access-25zh5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64\" (UID: \"15375d1d-d31e-454c-a20f-1cf285b924fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" Jul 08 12:06:53.095069 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:53.095018 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15375d1d-d31e-454c-a20f-1cf285b924fa-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64\" (UID: \"15375d1d-d31e-454c-a20f-1cf285b924fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" Jul 08 12:06:53.095259 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:53.095121 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15375d1d-d31e-454c-a20f-1cf285b924fa-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64\" (UID: \"15375d1d-d31e-454c-a20f-1cf285b924fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" Jul 08 12:06:53.195694 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:53.195642 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15375d1d-d31e-454c-a20f-1cf285b924fa-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64\" (UID: \"15375d1d-d31e-454c-a20f-1cf285b924fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" Jul 08 12:06:53.195895 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:53.195743 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25zh5\" (UniqueName: \"kubernetes.io/projected/15375d1d-d31e-454c-a20f-1cf285b924fa-kube-api-access-25zh5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64\" (UID: \"15375d1d-d31e-454c-a20f-1cf285b924fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" Jul 08 12:06:53.195895 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:53.195772 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15375d1d-d31e-454c-a20f-1cf285b924fa-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64\" (UID: \"15375d1d-d31e-454c-a20f-1cf285b924fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" Jul 08 12:06:53.196091 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:53.196068 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15375d1d-d31e-454c-a20f-1cf285b924fa-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64\" (UID: \"15375d1d-d31e-454c-a20f-1cf285b924fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" Jul 08 12:06:53.196182 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:53.196163 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15375d1d-d31e-454c-a20f-1cf285b924fa-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64\" (UID: \"15375d1d-d31e-454c-a20f-1cf285b924fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" Jul 08 12:06:53.207697 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:53.207665 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25zh5\" (UniqueName: \"kubernetes.io/projected/15375d1d-d31e-454c-a20f-1cf285b924fa-kube-api-access-25zh5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64\" (UID: \"15375d1d-d31e-454c-a20f-1cf285b924fa\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" Jul 08 12:06:53.271269 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:53.271233 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" Jul 08 12:06:53.423870 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:53.423846 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64"] Jul 08 12:06:53.425870 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:06:53.425834 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15375d1d_d31e_454c_a20f_1cf285b924fa.slice/crio-f7359d4dfe93d7b7a4d968964dacbf1f883b4eed411b9050a1c21332ec182d9d WatchSource:0}: Error finding container f7359d4dfe93d7b7a4d968964dacbf1f883b4eed411b9050a1c21332ec182d9d: Status 404 returned error can't find the container with id f7359d4dfe93d7b7a4d968964dacbf1f883b4eed411b9050a1c21332ec182d9d Jul 08 12:06:54.371116 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:54.371081 2560 generic.go:356] "Generic (PLEG): container finished" podID="15375d1d-d31e-454c-a20f-1cf285b924fa" containerID="3dae7b82e22ee3cdcfce3623eb784d5684773e377dbafd32ca4bd79ad1197d4a" exitCode=0 Jul 08 12:06:54.371490 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:54.371154 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" event={"ID":"15375d1d-d31e-454c-a20f-1cf285b924fa","Type":"ContainerDied","Data":"3dae7b82e22ee3cdcfce3623eb784d5684773e377dbafd32ca4bd79ad1197d4a"} Jul 08 12:06:54.371490 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:54.371195 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" event={"ID":"15375d1d-d31e-454c-a20f-1cf285b924fa","Type":"ContainerStarted","Data":"f7359d4dfe93d7b7a4d968964dacbf1f883b4eed411b9050a1c21332ec182d9d"} Jul 08 12:06:54.372191 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:54.372173 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 12:06:55.188904 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:55.188869 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:55.415232 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:55.415182 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:56.382506 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:56.382475 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" event={"ID":"15375d1d-d31e-454c-a20f-1cf285b924fa","Type":"ContainerStarted","Data":"d936958d4578edca4477d74bc04082ed5942338188eb1ea83465e7e2d62cf06c"} Jul 08 12:06:56.589509 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:56.589410 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:56.751673 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:56.751638 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:57.388619 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:57.388583 2560 generic.go:356] "Generic (PLEG): container finished" podID="15375d1d-d31e-454c-a20f-1cf285b924fa" containerID="d936958d4578edca4477d74bc04082ed5942338188eb1ea83465e7e2d62cf06c" exitCode=0 Jul 08 12:06:57.388780 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:57.388666 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" event={"ID":"15375d1d-d31e-454c-a20f-1cf285b924fa","Type":"ContainerDied","Data":"d936958d4578edca4477d74bc04082ed5942338188eb1ea83465e7e2d62cf06c"} Jul 08 12:06:58.394775 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:58.394742 2560 generic.go:356] "Generic (PLEG): container finished" podID="15375d1d-d31e-454c-a20f-1cf285b924fa" containerID="24bbf0a418c4ba38d937fd59f659da3a3535c389e3f1897b7156087a3a299795" exitCode=0 Jul 08 12:06:58.395206 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:58.394829 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" event={"ID":"15375d1d-d31e-454c-a20f-1cf285b924fa","Type":"ContainerDied","Data":"24bbf0a418c4ba38d937fd59f659da3a3535c389e3f1897b7156087a3a299795"} Jul 08 12:06:58.530378 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:58.530321 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:58.629524 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:58.629486 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:59.526102 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:59.526074 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" Jul 08 12:06:59.666567 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:59.666477 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15375d1d-d31e-454c-a20f-1cf285b924fa-util\") pod \"15375d1d-d31e-454c-a20f-1cf285b924fa\" (UID: \"15375d1d-d31e-454c-a20f-1cf285b924fa\") " Jul 08 12:06:59.666567 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:59.666529 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25zh5\" (UniqueName: \"kubernetes.io/projected/15375d1d-d31e-454c-a20f-1cf285b924fa-kube-api-access-25zh5\") pod \"15375d1d-d31e-454c-a20f-1cf285b924fa\" (UID: \"15375d1d-d31e-454c-a20f-1cf285b924fa\") " Jul 08 12:06:59.666567 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:59.666549 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15375d1d-d31e-454c-a20f-1cf285b924fa-bundle\") pod \"15375d1d-d31e-454c-a20f-1cf285b924fa\" (UID: \"15375d1d-d31e-454c-a20f-1cf285b924fa\") " Jul 08 12:06:59.667040 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:59.667003 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15375d1d-d31e-454c-a20f-1cf285b924fa-bundle" (OuterVolumeSpecName: "bundle") pod "15375d1d-d31e-454c-a20f-1cf285b924fa" (UID: "15375d1d-d31e-454c-a20f-1cf285b924fa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:06:59.668634 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:59.668604 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15375d1d-d31e-454c-a20f-1cf285b924fa-kube-api-access-25zh5" (OuterVolumeSpecName: "kube-api-access-25zh5") pod "15375d1d-d31e-454c-a20f-1cf285b924fa" (UID: "15375d1d-d31e-454c-a20f-1cf285b924fa"). InnerVolumeSpecName "kube-api-access-25zh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:06:59.671589 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:59.671567 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15375d1d-d31e-454c-a20f-1cf285b924fa-util" (OuterVolumeSpecName: "util") pod "15375d1d-d31e-454c-a20f-1cf285b924fa" (UID: "15375d1d-d31e-454c-a20f-1cf285b924fa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:06:59.759704 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:59.759635 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:06:59.767062 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:59.767038 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25zh5\" (UniqueName: \"kubernetes.io/projected/15375d1d-d31e-454c-a20f-1cf285b924fa-kube-api-access-25zh5\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:06:59.767062 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:59.767063 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15375d1d-d31e-454c-a20f-1cf285b924fa-bundle\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:06:59.767207 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:59.767072 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15375d1d-d31e-454c-a20f-1cf285b924fa-util\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:06:59.865303 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:06:59.865268 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:00.404549 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:00.404510 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" event={"ID":"15375d1d-d31e-454c-a20f-1cf285b924fa","Type":"ContainerDied","Data":"f7359d4dfe93d7b7a4d968964dacbf1f883b4eed411b9050a1c21332ec182d9d"} Jul 08 12:07:00.404748 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:00.404568 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7359d4dfe93d7b7a4d968964dacbf1f883b4eed411b9050a1c21332ec182d9d" Jul 08 12:07:00.404748 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:00.404525 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqv64" Jul 08 12:07:03.030807 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.030774 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:03.429991 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.429895 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-s7f72"] Jul 08 12:07:03.430243 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.430231 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15375d1d-d31e-454c-a20f-1cf285b924fa" containerName="util" Jul 08 12:07:03.430287 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.430245 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="15375d1d-d31e-454c-a20f-1cf285b924fa" containerName="util" Jul 08 12:07:03.430287 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.430265 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15375d1d-d31e-454c-a20f-1cf285b924fa" containerName="pull" Jul 08 12:07:03.430287 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.430270 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="15375d1d-d31e-454c-a20f-1cf285b924fa" containerName="pull" Jul 08 12:07:03.430287 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.430286 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15375d1d-d31e-454c-a20f-1cf285b924fa" containerName="extract" Jul 08 12:07:03.430401 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.430291 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="15375d1d-d31e-454c-a20f-1cf285b924fa" containerName="extract" Jul 08 12:07:03.430401 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.430350 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="15375d1d-d31e-454c-a20f-1cf285b924fa" containerName="extract" Jul 08 12:07:03.434638 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.434618 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-s7f72" Jul 08 12:07:03.438182 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.438164 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jcjzg\"" Jul 08 12:07:03.438285 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.438204 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 08 12:07:03.439135 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.439117 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 08 12:07:03.451392 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.451362 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-s7f72"] Jul 08 12:07:03.567491 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.567441 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:03.600625 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.600585 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvx46\" (UniqueName: \"kubernetes.io/projected/9a3332ae-089a-4a76-8946-4a5710151655-kube-api-access-gvx46\") pod \"cert-manager-55b4d954d5-s7f72\" (UID: \"9a3332ae-089a-4a76-8946-4a5710151655\") " pod="cert-manager/cert-manager-55b4d954d5-s7f72" Jul 08 12:07:03.600793 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.600639 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a3332ae-089a-4a76-8946-4a5710151655-bound-sa-token\") pod \"cert-manager-55b4d954d5-s7f72\" (UID: \"9a3332ae-089a-4a76-8946-4a5710151655\") " pod="cert-manager/cert-manager-55b4d954d5-s7f72" Jul 08 12:07:03.670122 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.670070 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:03.701121 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.701053 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvx46\" (UniqueName: \"kubernetes.io/projected/9a3332ae-089a-4a76-8946-4a5710151655-kube-api-access-gvx46\") pod \"cert-manager-55b4d954d5-s7f72\" (UID: \"9a3332ae-089a-4a76-8946-4a5710151655\") " pod="cert-manager/cert-manager-55b4d954d5-s7f72" Jul 08 12:07:03.701121 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.701102 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a3332ae-089a-4a76-8946-4a5710151655-bound-sa-token\") pod \"cert-manager-55b4d954d5-s7f72\" (UID: \"9a3332ae-089a-4a76-8946-4a5710151655\") " pod="cert-manager/cert-manager-55b4d954d5-s7f72" Jul 08 12:07:03.720266 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.720228 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a3332ae-089a-4a76-8946-4a5710151655-bound-sa-token\") pod \"cert-manager-55b4d954d5-s7f72\" (UID: \"9a3332ae-089a-4a76-8946-4a5710151655\") " pod="cert-manager/cert-manager-55b4d954d5-s7f72" Jul 08 12:07:03.720402 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.720364 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvx46\" (UniqueName: \"kubernetes.io/projected/9a3332ae-089a-4a76-8946-4a5710151655-kube-api-access-gvx46\") pod \"cert-manager-55b4d954d5-s7f72\" (UID: \"9a3332ae-089a-4a76-8946-4a5710151655\") " pod="cert-manager/cert-manager-55b4d954d5-s7f72" Jul 08 12:07:03.743694 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.743658 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-s7f72" Jul 08 12:07:03.884248 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:03.884224 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-s7f72"] Jul 08 12:07:03.886872 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:07:03.886844 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a3332ae_089a_4a76_8946_4a5710151655.slice/crio-c78e776b9cde47b720ba989f6a69c6bc2111c05fea40c9c1b33036f90935709d WatchSource:0}: Error finding container c78e776b9cde47b720ba989f6a69c6bc2111c05fea40c9c1b33036f90935709d: Status 404 returned error can't find the container with id c78e776b9cde47b720ba989f6a69c6bc2111c05fea40c9c1b33036f90935709d Jul 08 12:07:04.425122 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:04.425081 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-s7f72" event={"ID":"9a3332ae-089a-4a76-8946-4a5710151655","Type":"ContainerStarted","Data":"c78e776b9cde47b720ba989f6a69c6bc2111c05fea40c9c1b33036f90935709d"} Jul 08 12:07:06.435403 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:06.435360 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-s7f72" event={"ID":"9a3332ae-089a-4a76-8946-4a5710151655","Type":"ContainerStarted","Data":"0bcdd052de615bd76a2f261649ac6dfacc8d259d10d6741ceef6394a501c0272"} Jul 08 12:07:06.456599 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:06.456536 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-s7f72" podStartSLOduration=1.113433794 podStartE2EDuration="3.456517353s" totalImagesPullingTime="2.343083559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:07:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:07:06.455269025 +0000 UTC m=+337.815008329" watchObservedRunningTime="2026-07-08 12:07:06.456517353 +0000 UTC m=+337.816256659" Jul 08 12:07:09.790505 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:09.790471 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:09.879694 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:09.879658 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:11.670538 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:11.670499 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd"] Jul 08 12:07:11.719644 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:11.719610 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd"] Jul 08 12:07:11.719810 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:11.719737 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd" Jul 08 12:07:11.724839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:11.724816 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 12:07:11.725017 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:11.724986 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 12:07:11.725157 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:11.725046 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ngf7m\"" Jul 08 12:07:11.742021 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:11.741987 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:11.771034 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:11.771003 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7grgt\" (UniqueName: \"kubernetes.io/projected/2b6db2ac-a644-4aae-a10b-1e4c1fa18677-kube-api-access-7grgt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd\" (UID: \"2b6db2ac-a644-4aae-a10b-1e4c1fa18677\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd" Jul 08 12:07:11.771202 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:11.771057 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b6db2ac-a644-4aae-a10b-1e4c1fa18677-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd\" (UID: \"2b6db2ac-a644-4aae-a10b-1e4c1fa18677\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd" Jul 08 12:07:11.771202 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:11.771138 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b6db2ac-a644-4aae-a10b-1e4c1fa18677-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd\" (UID: \"2b6db2ac-a644-4aae-a10b-1e4c1fa18677\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd" Jul 08 12:07:11.872362 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:11.872331 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7grgt\" (UniqueName: \"kubernetes.io/projected/2b6db2ac-a644-4aae-a10b-1e4c1fa18677-kube-api-access-7grgt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd\" (UID: \"2b6db2ac-a644-4aae-a10b-1e4c1fa18677\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd" Jul 08 12:07:11.872498 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:11.872376 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b6db2ac-a644-4aae-a10b-1e4c1fa18677-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd\" (UID: \"2b6db2ac-a644-4aae-a10b-1e4c1fa18677\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd" Jul 08 12:07:11.872582 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:11.872560 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b6db2ac-a644-4aae-a10b-1e4c1fa18677-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd\" (UID: \"2b6db2ac-a644-4aae-a10b-1e4c1fa18677\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd" Jul 08 12:07:11.872775 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:11.872756 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b6db2ac-a644-4aae-a10b-1e4c1fa18677-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd\" (UID: \"2b6db2ac-a644-4aae-a10b-1e4c1fa18677\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd" Jul 08 12:07:11.872899 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:11.872882 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b6db2ac-a644-4aae-a10b-1e4c1fa18677-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd\" (UID: \"2b6db2ac-a644-4aae-a10b-1e4c1fa18677\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd" Jul 08 12:07:11.883681 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:11.883650 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7grgt\" (UniqueName: \"kubernetes.io/projected/2b6db2ac-a644-4aae-a10b-1e4c1fa18677-kube-api-access-7grgt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd\" (UID: \"2b6db2ac-a644-4aae-a10b-1e4c1fa18677\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd" Jul 08 12:07:12.028748 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:12.028716 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd" Jul 08 12:07:12.193505 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:12.193478 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd"] Jul 08 12:07:12.195617 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:07:12.195583 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6db2ac_a644_4aae_a10b_1e4c1fa18677.slice/crio-e4488f4ce2ac78564516a5b52e1921fc7ac8e809049324598a2caf5d6e36169b WatchSource:0}: Error finding container e4488f4ce2ac78564516a5b52e1921fc7ac8e809049324598a2caf5d6e36169b: Status 404 returned error can't find the container with id e4488f4ce2ac78564516a5b52e1921fc7ac8e809049324598a2caf5d6e36169b Jul 08 12:07:12.474691 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:12.474655 2560 generic.go:356] "Generic (PLEG): container finished" podID="2b6db2ac-a644-4aae-a10b-1e4c1fa18677" containerID="64fcb00760781132521e4ca319b170c337145e1f9594247f32a568a219357e0c" exitCode=0 Jul 08 12:07:12.474844 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:12.474710 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd" event={"ID":"2b6db2ac-a644-4aae-a10b-1e4c1fa18677","Type":"ContainerDied","Data":"64fcb00760781132521e4ca319b170c337145e1f9594247f32a568a219357e0c"} Jul 08 12:07:12.474844 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:12.474759 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd" event={"ID":"2b6db2ac-a644-4aae-a10b-1e4c1fa18677","Type":"ContainerStarted","Data":"e4488f4ce2ac78564516a5b52e1921fc7ac8e809049324598a2caf5d6e36169b"} Jul 08 12:07:14.484175 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:14.484138 2560 generic.go:356] "Generic (PLEG): container finished" podID="2b6db2ac-a644-4aae-a10b-1e4c1fa18677" containerID="bce91cf3a2572ff180604ed0abe29d69dea1a5df71fab741c25431b587776275" exitCode=0 Jul 08 12:07:14.484559 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:14.484208 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd" event={"ID":"2b6db2ac-a644-4aae-a10b-1e4c1fa18677","Type":"ContainerDied","Data":"bce91cf3a2572ff180604ed0abe29d69dea1a5df71fab741c25431b587776275"} Jul 08 12:07:15.489928 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:15.489883 2560 generic.go:356] "Generic (PLEG): container finished" podID="2b6db2ac-a644-4aae-a10b-1e4c1fa18677" containerID="b227a4e4f8f6f5d6d2bf29212201965a87a3f95fee9e414f585e4d4e642606da" exitCode=0 Jul 08 12:07:15.490310 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:15.489945 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd" event={"ID":"2b6db2ac-a644-4aae-a10b-1e4c1fa18677","Type":"ContainerDied","Data":"b227a4e4f8f6f5d6d2bf29212201965a87a3f95fee9e414f585e4d4e642606da"} Jul 08 12:07:16.619090 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:16.619066 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd" Jul 08 12:07:16.714029 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:16.713991 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7grgt\" (UniqueName: \"kubernetes.io/projected/2b6db2ac-a644-4aae-a10b-1e4c1fa18677-kube-api-access-7grgt\") pod \"2b6db2ac-a644-4aae-a10b-1e4c1fa18677\" (UID: \"2b6db2ac-a644-4aae-a10b-1e4c1fa18677\") " Jul 08 12:07:16.714200 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:16.714053 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b6db2ac-a644-4aae-a10b-1e4c1fa18677-bundle\") pod \"2b6db2ac-a644-4aae-a10b-1e4c1fa18677\" (UID: \"2b6db2ac-a644-4aae-a10b-1e4c1fa18677\") " Jul 08 12:07:16.714200 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:16.714120 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b6db2ac-a644-4aae-a10b-1e4c1fa18677-util\") pod \"2b6db2ac-a644-4aae-a10b-1e4c1fa18677\" (UID: \"2b6db2ac-a644-4aae-a10b-1e4c1fa18677\") " Jul 08 12:07:16.714749 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:16.714724 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b6db2ac-a644-4aae-a10b-1e4c1fa18677-bundle" (OuterVolumeSpecName: "bundle") pod "2b6db2ac-a644-4aae-a10b-1e4c1fa18677" (UID: "2b6db2ac-a644-4aae-a10b-1e4c1fa18677"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:07:16.716083 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:16.716057 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b6db2ac-a644-4aae-a10b-1e4c1fa18677-kube-api-access-7grgt" (OuterVolumeSpecName: "kube-api-access-7grgt") pod "2b6db2ac-a644-4aae-a10b-1e4c1fa18677" (UID: "2b6db2ac-a644-4aae-a10b-1e4c1fa18677"). InnerVolumeSpecName "kube-api-access-7grgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:07:16.719958 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:16.719933 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b6db2ac-a644-4aae-a10b-1e4c1fa18677-util" (OuterVolumeSpecName: "util") pod "2b6db2ac-a644-4aae-a10b-1e4c1fa18677" (UID: "2b6db2ac-a644-4aae-a10b-1e4c1fa18677"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:07:16.815670 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:16.815638 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b6db2ac-a644-4aae-a10b-1e4c1fa18677-bundle\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:07:16.815670 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:16.815672 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b6db2ac-a644-4aae-a10b-1e4c1fa18677-util\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:07:16.815877 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:16.815685 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7grgt\" (UniqueName: \"kubernetes.io/projected/2b6db2ac-a644-4aae-a10b-1e4c1fa18677-kube-api-access-7grgt\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:07:17.498883 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:17.498795 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd" event={"ID":"2b6db2ac-a644-4aae-a10b-1e4c1fa18677","Type":"ContainerDied","Data":"e4488f4ce2ac78564516a5b52e1921fc7ac8e809049324598a2caf5d6e36169b"} Jul 08 12:07:17.498883 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:17.498833 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5djvd" Jul 08 12:07:17.498883 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:17.498843 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4488f4ce2ac78564516a5b52e1921fc7ac8e809049324598a2caf5d6e36169b" Jul 08 12:07:26.425466 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:26.425363 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:26.517052 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:26.517012 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:26.822268 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:26.822237 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:27.655856 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:27.655817 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:27.763248 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:27.763204 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:27.903656 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:27.903620 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl"] Jul 08 12:07:27.903991 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:27.903978 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6db2ac-a644-4aae-a10b-1e4c1fa18677" containerName="extract" Jul 08 12:07:27.904038 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:27.903992 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6db2ac-a644-4aae-a10b-1e4c1fa18677" containerName="extract" Jul 08 12:07:27.904038 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:27.904006 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6db2ac-a644-4aae-a10b-1e4c1fa18677" containerName="pull" Jul 08 12:07:27.904038 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:27.904013 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6db2ac-a644-4aae-a10b-1e4c1fa18677" containerName="pull" Jul 08 12:07:27.904038 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:27.904020 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6db2ac-a644-4aae-a10b-1e4c1fa18677" containerName="util" Jul 08 12:07:27.904038 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:27.904026 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6db2ac-a644-4aae-a10b-1e4c1fa18677" containerName="util" Jul 08 12:07:27.904183 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:27.904079 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b6db2ac-a644-4aae-a10b-1e4c1fa18677" containerName="extract" Jul 08 12:07:27.907064 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:27.907011 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:27.918825 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:27.918800 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 12:07:27.918940 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:27.918922 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 12:07:27.919240 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:27.919225 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 12:07:27.919281 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:27.919225 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 12:07:27.919549 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:27.919534 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bp9fb\"" Jul 08 12:07:27.947682 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:27.947650 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl"] Jul 08 12:07:28.010307 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.010270 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57ckj\" (UniqueName: \"kubernetes.io/projected/7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9-kube-api-access-57ckj\") pod \"opendatahub-operator-controller-manager-6db55b68b6-85fkl\" (UID: \"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9\") " pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:28.010307 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.010311 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6db55b68b6-85fkl\" (UID: \"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9\") " pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:28.010507 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.010350 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9-tmp\") pod \"opendatahub-operator-controller-manager-6db55b68b6-85fkl\" (UID: \"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9\") " pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:28.010507 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.010385 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6db55b68b6-85fkl\" (UID: \"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9\") " pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:28.010572 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.010501 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9-manifests\") pod \"opendatahub-operator-controller-manager-6db55b68b6-85fkl\" (UID: \"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9\") " pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:28.111703 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.111669 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9-tmp\") pod \"opendatahub-operator-controller-manager-6db55b68b6-85fkl\" (UID: \"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9\") " pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:28.111703 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.111705 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6db55b68b6-85fkl\" (UID: \"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9\") " pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:28.111938 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.111755 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9-manifests\") pod \"opendatahub-operator-controller-manager-6db55b68b6-85fkl\" (UID: \"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9\") " pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:28.111938 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.111779 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57ckj\" (UniqueName: \"kubernetes.io/projected/7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9-kube-api-access-57ckj\") pod \"opendatahub-operator-controller-manager-6db55b68b6-85fkl\" (UID: \"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9\") " pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:28.111938 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.111800 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6db55b68b6-85fkl\" (UID: \"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9\") " pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:28.112230 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.112208 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9-manifests\") pod \"opendatahub-operator-controller-manager-6db55b68b6-85fkl\" (UID: \"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9\") " pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:28.114028 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.114001 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9-tmp\") pod \"opendatahub-operator-controller-manager-6db55b68b6-85fkl\" (UID: \"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9\") " pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:28.114198 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.114182 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6db55b68b6-85fkl\" (UID: \"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9\") " pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:28.114248 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.114220 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6db55b68b6-85fkl\" (UID: \"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9\") " pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:28.131156 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.131126 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57ckj\" (UniqueName: \"kubernetes.io/projected/7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9-kube-api-access-57ckj\") pod \"opendatahub-operator-controller-manager-6db55b68b6-85fkl\" (UID: \"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9\") " pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:28.160180 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.160091 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:28.217040 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.217005 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:28.254705 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.254674 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:28.363999 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.363950 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:28.373143 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.373123 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl"] Jul 08 12:07:28.374990 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:07:28.374969 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bdc0b3c_e4ba_4e3e_802f_8bea3cf1b2b9.slice/crio-8d5c1a37ee4930d1a7475e12ab9865fd0f11c3242f4262a5e96d83558db2ae96 WatchSource:0}: Error finding container 8d5c1a37ee4930d1a7475e12ab9865fd0f11c3242f4262a5e96d83558db2ae96: Status 404 returned error can't find the container with id 8d5c1a37ee4930d1a7475e12ab9865fd0f11c3242f4262a5e96d83558db2ae96 Jul 08 12:07:28.437666 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.437573 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:28.539597 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.539563 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:28.545207 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.545177 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" event={"ID":"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9","Type":"ContainerStarted","Data":"8d5c1a37ee4930d1a7475e12ab9865fd0f11c3242f4262a5e96d83558db2ae96"} Jul 08 12:07:28.635865 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.635832 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:28.744344 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.744258 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:28.839365 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.839330 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:28.941331 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:28.941287 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:31.562088 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:31.562047 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" event={"ID":"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9","Type":"ContainerStarted","Data":"5aab158cf5ad35b9987ac25f8b362b972e99d65b1cd6b9328c1c9698dc2ff1bb"} Jul 08 12:07:32.568621 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:32.568590 2560 generic.go:356] "Generic (PLEG): container finished" podID="7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9" containerID="5aab158cf5ad35b9987ac25f8b362b972e99d65b1cd6b9328c1c9698dc2ff1bb" exitCode=0 Jul 08 12:07:32.569011 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:32.568647 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" event={"ID":"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9","Type":"ContainerDied","Data":"5aab158cf5ad35b9987ac25f8b362b972e99d65b1cd6b9328c1c9698dc2ff1bb"} Jul 08 12:07:33.428377 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:33.428268 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:33.515359 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:33.515320 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:33.574669 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:33.574636 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" event={"ID":"7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9","Type":"ContainerStarted","Data":"8d9e68bbc9bf8025f8f1a408cf1453da56379e8a7ed81637cd852d1372dad018"} Jul 08 12:07:33.575095 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:33.574780 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:33.611495 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:33.611423 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" podStartSLOduration=2.105819488 podStartE2EDuration="6.611400839s" totalImagesPullingTime="3.41222154s" totalInitContainerRuntime="1.093359811s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:07:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:07:33.609423441 +0000 UTC m=+364.969162748" watchObservedRunningTime="2026-07-08 12:07:33.611400839 +0000 UTC m=+364.971140147" Jul 08 12:07:43.012251 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:43.012213 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:44.581101 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:44.581066 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6db55b68b6-85fkl" Jul 08 12:07:47.923509 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:47.923462 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:48.617045 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.617010 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-765c5b48c6-vtbsx"] Jul 08 12:07:48.625457 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.625437 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-765c5b48c6-vtbsx" Jul 08 12:07:48.630330 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.630308 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 08 12:07:48.630480 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.630405 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 08 12:07:48.630480 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.630431 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 12:07:48.630598 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.630511 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 12:07:48.644161 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.644132 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-765c5b48c6-vtbsx"] Jul 08 12:07:48.803793 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.803753 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dd3cf00-05d6-495f-ba49-be9111a615f1-tmp\") pod \"kube-auth-proxy-765c5b48c6-vtbsx\" (UID: \"3dd3cf00-05d6-495f-ba49-be9111a615f1\") " pod="openshift-ingress/kube-auth-proxy-765c5b48c6-vtbsx" Jul 08 12:07:48.804019 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.803822 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksl2r\" (UniqueName: \"kubernetes.io/projected/3dd3cf00-05d6-495f-ba49-be9111a615f1-kube-api-access-ksl2r\") pod \"kube-auth-proxy-765c5b48c6-vtbsx\" (UID: \"3dd3cf00-05d6-495f-ba49-be9111a615f1\") " pod="openshift-ingress/kube-auth-proxy-765c5b48c6-vtbsx" Jul 08 12:07:48.804019 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.803862 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd3cf00-05d6-495f-ba49-be9111a615f1-tls-certs\") pod \"kube-auth-proxy-765c5b48c6-vtbsx\" (UID: \"3dd3cf00-05d6-495f-ba49-be9111a615f1\") " pod="openshift-ingress/kube-auth-proxy-765c5b48c6-vtbsx" Jul 08 12:07:48.814334 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.814296 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-694hd"] Jul 08 12:07:48.817734 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.817719 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-694hd" Jul 08 12:07:48.821584 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.821558 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 08 12:07:48.821727 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.821708 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-85g7z\"" Jul 08 12:07:48.838216 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.838183 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-694hd"] Jul 08 12:07:48.905062 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.904976 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dd3cf00-05d6-495f-ba49-be9111a615f1-tmp\") pod \"kube-auth-proxy-765c5b48c6-vtbsx\" (UID: \"3dd3cf00-05d6-495f-ba49-be9111a615f1\") " pod="openshift-ingress/kube-auth-proxy-765c5b48c6-vtbsx" Jul 08 12:07:48.905062 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.905034 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksl2r\" (UniqueName: \"kubernetes.io/projected/3dd3cf00-05d6-495f-ba49-be9111a615f1-kube-api-access-ksl2r\") pod \"kube-auth-proxy-765c5b48c6-vtbsx\" (UID: \"3dd3cf00-05d6-495f-ba49-be9111a615f1\") " pod="openshift-ingress/kube-auth-proxy-765c5b48c6-vtbsx" Jul 08 12:07:48.905251 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.905085 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd3cf00-05d6-495f-ba49-be9111a615f1-tls-certs\") pod \"kube-auth-proxy-765c5b48c6-vtbsx\" (UID: \"3dd3cf00-05d6-495f-ba49-be9111a615f1\") " pod="openshift-ingress/kube-auth-proxy-765c5b48c6-vtbsx" Jul 08 12:07:48.907361 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.907331 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dd3cf00-05d6-495f-ba49-be9111a615f1-tmp\") pod \"kube-auth-proxy-765c5b48c6-vtbsx\" (UID: \"3dd3cf00-05d6-495f-ba49-be9111a615f1\") " pod="openshift-ingress/kube-auth-proxy-765c5b48c6-vtbsx" Jul 08 12:07:48.907605 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.907584 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd3cf00-05d6-495f-ba49-be9111a615f1-tls-certs\") pod \"kube-auth-proxy-765c5b48c6-vtbsx\" (UID: \"3dd3cf00-05d6-495f-ba49-be9111a615f1\") " pod="openshift-ingress/kube-auth-proxy-765c5b48c6-vtbsx" Jul 08 12:07:48.936511 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:48.936477 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksl2r\" (UniqueName: \"kubernetes.io/projected/3dd3cf00-05d6-495f-ba49-be9111a615f1-kube-api-access-ksl2r\") pod \"kube-auth-proxy-765c5b48c6-vtbsx\" (UID: \"3dd3cf00-05d6-495f-ba49-be9111a615f1\") " pod="openshift-ingress/kube-auth-proxy-765c5b48c6-vtbsx" Jul 08 12:07:49.005544 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:49.005515 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ec4bbe5-522e-4caf-8005-6fdcd5601001-cert\") pod \"odh-model-controller-7998c67dc4-694hd\" (UID: \"4ec4bbe5-522e-4caf-8005-6fdcd5601001\") " pod="opendatahub/odh-model-controller-7998c67dc4-694hd" Jul 08 12:07:49.005717 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:49.005556 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p9rd\" (UniqueName: \"kubernetes.io/projected/4ec4bbe5-522e-4caf-8005-6fdcd5601001-kube-api-access-7p9rd\") pod \"odh-model-controller-7998c67dc4-694hd\" (UID: \"4ec4bbe5-522e-4caf-8005-6fdcd5601001\") " pod="opendatahub/odh-model-controller-7998c67dc4-694hd" Jul 08 12:07:49.106777 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:49.106741 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ec4bbe5-522e-4caf-8005-6fdcd5601001-cert\") pod \"odh-model-controller-7998c67dc4-694hd\" (UID: \"4ec4bbe5-522e-4caf-8005-6fdcd5601001\") " pod="opendatahub/odh-model-controller-7998c67dc4-694hd" Jul 08 12:07:49.106777 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:49.106782 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p9rd\" (UniqueName: \"kubernetes.io/projected/4ec4bbe5-522e-4caf-8005-6fdcd5601001-kube-api-access-7p9rd\") pod \"odh-model-controller-7998c67dc4-694hd\" (UID: \"4ec4bbe5-522e-4caf-8005-6fdcd5601001\") " pod="opendatahub/odh-model-controller-7998c67dc4-694hd" Jul 08 12:07:49.109209 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:49.109182 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ec4bbe5-522e-4caf-8005-6fdcd5601001-cert\") pod \"odh-model-controller-7998c67dc4-694hd\" (UID: \"4ec4bbe5-522e-4caf-8005-6fdcd5601001\") " pod="opendatahub/odh-model-controller-7998c67dc4-694hd" Jul 08 12:07:49.139612 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:49.139579 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p9rd\" (UniqueName: \"kubernetes.io/projected/4ec4bbe5-522e-4caf-8005-6fdcd5601001-kube-api-access-7p9rd\") pod \"odh-model-controller-7998c67dc4-694hd\" (UID: \"4ec4bbe5-522e-4caf-8005-6fdcd5601001\") " pod="opendatahub/odh-model-controller-7998c67dc4-694hd" Jul 08 12:07:49.234737 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:49.234635 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-765c5b48c6-vtbsx" Jul 08 12:07:49.343728 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:49.343690 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:49.401930 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:49.401888 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-765c5b48c6-vtbsx"] Jul 08 12:07:49.407010 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:07:49.406983 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd3cf00_05d6_495f_ba49_be9111a615f1.slice/crio-04d44aa7523ade71fa7edaa9625c77cb338e01dc373972c464708829f6865c1f WatchSource:0}: Error finding container 04d44aa7523ade71fa7edaa9625c77cb338e01dc373972c464708829f6865c1f: Status 404 returned error can't find the container with id 04d44aa7523ade71fa7edaa9625c77cb338e01dc373972c464708829f6865c1f Jul 08 12:07:49.427804 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:49.427780 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-694hd" Jul 08 12:07:49.581095 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:07:49.581056 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec4bbe5_522e_4caf_8005_6fdcd5601001.slice/crio-2eedbcc5c057e7a42437458cfb7e6ee9de04f829996f625c4d8fd3fcd8bf15c5 WatchSource:0}: Error finding container 2eedbcc5c057e7a42437458cfb7e6ee9de04f829996f625c4d8fd3fcd8bf15c5: Status 404 returned error can't find the container with id 2eedbcc5c057e7a42437458cfb7e6ee9de04f829996f625c4d8fd3fcd8bf15c5 Jul 08 12:07:49.581845 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:49.581824 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-694hd"] Jul 08 12:07:49.647212 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:49.647176 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-765c5b48c6-vtbsx" event={"ID":"3dd3cf00-05d6-495f-ba49-be9111a615f1","Type":"ContainerStarted","Data":"04d44aa7523ade71fa7edaa9625c77cb338e01dc373972c464708829f6865c1f"} Jul 08 12:07:49.648291 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:49.648266 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-694hd" event={"ID":"4ec4bbe5-522e-4caf-8005-6fdcd5601001","Type":"ContainerStarted","Data":"2eedbcc5c057e7a42437458cfb7e6ee9de04f829996f625c4d8fd3fcd8bf15c5"} Jul 08 12:07:50.450220 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:50.450181 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:50.655321 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:50.654982 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-f25kr"] Jul 08 12:07:50.659466 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:50.659444 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-f25kr" Jul 08 12:07:50.670689 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:50.669878 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-ktlk2\"" Jul 08 12:07:50.671859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:50.671834 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 08 12:07:50.704075 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:50.703663 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-f25kr"] Jul 08 12:07:50.739516 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:50.739173 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:50.827807 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:50.827657 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl986\" (UniqueName: \"kubernetes.io/projected/0f10b1bb-58b6-4a02-ab16-d75f3e4551ad-kube-api-access-gl986\") pod \"model-serving-api-54d89bd5fc-f25kr\" (UID: \"0f10b1bb-58b6-4a02-ab16-d75f3e4551ad\") " pod="opendatahub/model-serving-api-54d89bd5fc-f25kr" Jul 08 12:07:50.827807 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:50.827722 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f10b1bb-58b6-4a02-ab16-d75f3e4551ad-tls-certs\") pod \"model-serving-api-54d89bd5fc-f25kr\" (UID: \"0f10b1bb-58b6-4a02-ab16-d75f3e4551ad\") " pod="opendatahub/model-serving-api-54d89bd5fc-f25kr" Jul 08 12:07:50.928182 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:50.928148 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f10b1bb-58b6-4a02-ab16-d75f3e4551ad-tls-certs\") pod \"model-serving-api-54d89bd5fc-f25kr\" (UID: \"0f10b1bb-58b6-4a02-ab16-d75f3e4551ad\") " pod="opendatahub/model-serving-api-54d89bd5fc-f25kr" Jul 08 12:07:50.928375 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:50.928264 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl986\" (UniqueName: \"kubernetes.io/projected/0f10b1bb-58b6-4a02-ab16-d75f3e4551ad-kube-api-access-gl986\") pod \"model-serving-api-54d89bd5fc-f25kr\" (UID: \"0f10b1bb-58b6-4a02-ab16-d75f3e4551ad\") " pod="opendatahub/model-serving-api-54d89bd5fc-f25kr" Jul 08 12:07:50.931091 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:50.931063 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f10b1bb-58b6-4a02-ab16-d75f3e4551ad-tls-certs\") pod \"model-serving-api-54d89bd5fc-f25kr\" (UID: \"0f10b1bb-58b6-4a02-ab16-d75f3e4551ad\") " pod="opendatahub/model-serving-api-54d89bd5fc-f25kr" Jul 08 12:07:50.946984 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:50.946958 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl986\" (UniqueName: \"kubernetes.io/projected/0f10b1bb-58b6-4a02-ab16-d75f3e4551ad-kube-api-access-gl986\") pod \"model-serving-api-54d89bd5fc-f25kr\" (UID: \"0f10b1bb-58b6-4a02-ab16-d75f3e4551ad\") " pod="opendatahub/model-serving-api-54d89bd5fc-f25kr" Jul 08 12:07:50.976757 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:50.976672 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-f25kr" Jul 08 12:07:51.191146 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:51.190012 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-f25kr"] Jul 08 12:07:51.664751 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:51.664703 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-f25kr" event={"ID":"0f10b1bb-58b6-4a02-ab16-d75f3e4551ad","Type":"ContainerStarted","Data":"9314c61afce68f1cfee0d2df9b3af3172e4d279b3f8497ab3c02731ba80a055d"} Jul 08 12:07:51.770441 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:51.770405 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:51.887709 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:51.887656 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:53.885728 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:53.885635 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:54.683333 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:54.683291 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-765c5b48c6-vtbsx" event={"ID":"3dd3cf00-05d6-495f-ba49-be9111a615f1","Type":"ContainerStarted","Data":"798153faf5ae3aa98c9e4851656ba056fa58e07944b2ba6c61ba658648c6f41e"} Jul 08 12:07:54.684747 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:54.684718 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-694hd" event={"ID":"4ec4bbe5-522e-4caf-8005-6fdcd5601001","Type":"ContainerStarted","Data":"765a9e0cdd6e94481ec0999c852c39267e38c99d1c15a3ef5201f870212917a4"} Jul 08 12:07:54.684875 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:54.684808 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-694hd" Jul 08 12:07:54.686272 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:54.686251 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-f25kr" event={"ID":"0f10b1bb-58b6-4a02-ab16-d75f3e4551ad","Type":"ContainerStarted","Data":"b405c861de22394b6d7587c5fe72f300083af048e49517f330ed3d2397be8aad"} Jul 08 12:07:54.686385 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:54.686370 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-f25kr" Jul 08 12:07:54.708399 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:54.708350 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-765c5b48c6-vtbsx" podStartSLOduration=2.240351205 podStartE2EDuration="6.70833293s" totalImagesPullingTime="4.467981725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:07:54.706570608 +0000 UTC m=+386.066309917" watchObservedRunningTime="2026-07-08 12:07:54.70833293 +0000 UTC m=+386.068072239" Jul 08 12:07:54.731439 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:54.731388 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-f25kr" podStartSLOduration=2.050089552 podStartE2EDuration="4.731369729s" totalImagesPullingTime="2.681280177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:07:54.729194427 +0000 UTC m=+386.088933736" watchObservedRunningTime="2026-07-08 12:07:54.731369729 +0000 UTC m=+386.091109037" Jul 08 12:07:54.754803 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:54.754754 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-694hd" podStartSLOduration=2.453589447 podStartE2EDuration="6.754733925s" totalImagesPullingTime="4.301144478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:07:54.753950852 +0000 UTC m=+386.113690160" watchObservedRunningTime="2026-07-08 12:07:54.754733925 +0000 UTC m=+386.114473235" Jul 08 12:07:55.970135 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:55.970098 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:56.063477 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.063421 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:56.436382 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.436349 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:56.557652 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.557618 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4"] Jul 08 12:07:56.561994 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.561970 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.565473 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.565451 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 12:07:56.566000 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.565786 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-8jlmf\"" Jul 08 12:07:56.580031 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.580007 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjjnm\" (UniqueName: \"kubernetes.io/projected/48751fbb-ce21-4b1b-a741-b0129b72b287-kube-api-access-pjjnm\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.580266 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.580250 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48751fbb-ce21-4b1b-a741-b0129b72b287-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.580396 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.580380 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48751fbb-ce21-4b1b-a741-b0129b72b287-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.580488 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.580476 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48751fbb-ce21-4b1b-a741-b0129b72b287-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.580584 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.580571 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48751fbb-ce21-4b1b-a741-b0129b72b287-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.580670 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.580658 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48751fbb-ce21-4b1b-a741-b0129b72b287-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.580780 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.580767 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48751fbb-ce21-4b1b-a741-b0129b72b287-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.580871 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.580859 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48751fbb-ce21-4b1b-a741-b0129b72b287-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.580994 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.580978 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48751fbb-ce21-4b1b-a741-b0129b72b287-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.584249 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.584226 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4"] Jul 08 12:07:56.668055 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.668022 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:56.682217 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.682183 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48751fbb-ce21-4b1b-a741-b0129b72b287-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.682217 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.682217 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48751fbb-ce21-4b1b-a741-b0129b72b287-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.682437 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.682261 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48751fbb-ce21-4b1b-a741-b0129b72b287-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.682437 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.682288 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48751fbb-ce21-4b1b-a741-b0129b72b287-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.682437 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.682336 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48751fbb-ce21-4b1b-a741-b0129b72b287-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.682437 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.682385 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjjnm\" (UniqueName: \"kubernetes.io/projected/48751fbb-ce21-4b1b-a741-b0129b72b287-kube-api-access-pjjnm\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.682635 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.682451 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48751fbb-ce21-4b1b-a741-b0129b72b287-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.682635 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.682503 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48751fbb-ce21-4b1b-a741-b0129b72b287-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.682635 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.682532 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48751fbb-ce21-4b1b-a741-b0129b72b287-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.682786 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.682738 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48751fbb-ce21-4b1b-a741-b0129b72b287-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.682895 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.682874 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48751fbb-ce21-4b1b-a741-b0129b72b287-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.683107 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.683077 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48751fbb-ce21-4b1b-a741-b0129b72b287-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.683222 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.683179 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48751fbb-ce21-4b1b-a741-b0129b72b287-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.683432 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.683412 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48751fbb-ce21-4b1b-a741-b0129b72b287-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.684768 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.684748 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48751fbb-ce21-4b1b-a741-b0129b72b287-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.684962 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.684943 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48751fbb-ce21-4b1b-a741-b0129b72b287-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.699368 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.699311 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjjnm\" (UniqueName: \"kubernetes.io/projected/48751fbb-ce21-4b1b-a741-b0129b72b287-kube-api-access-pjjnm\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.705366 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.705340 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48751fbb-ce21-4b1b-a741-b0129b72b287-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mpnj4\" (UID: \"48751fbb-ce21-4b1b-a741-b0129b72b287\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:56.851355 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.851317 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:07:56.878401 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:56.878365 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:07:57.032607 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.032585 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4"] Jul 08 12:07:57.034903 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:07:57.034876 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48751fbb_ce21_4b1b_a741_b0129b72b287.slice/crio-2e3c1bc515a6829fd8d6bd7ef4b0e71c08c8dae033627c612cffb344306e7ff0 WatchSource:0}: Error finding container 2e3c1bc515a6829fd8d6bd7ef4b0e71c08c8dae033627c612cffb344306e7ff0: Status 404 returned error can't find the container with id 2e3c1bc515a6829fd8d6bd7ef4b0e71c08c8dae033627c612cffb344306e7ff0 Jul 08 12:07:57.568089 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.568062 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c77454567-nknh7"] Jul 08 12:07:57.571188 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.571167 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" Jul 08 12:07:57.576524 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.576500 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 12:07:57.577589 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.577566 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jfd5q\"" Jul 08 12:07:57.577589 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.577578 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 12:07:57.577763 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.577636 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 12:07:57.577763 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.577666 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 12:07:57.577931 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.577849 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 12:07:57.589743 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.589724 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/be530a2b-62b9-41fb-8b65-d0089830df5d-manager-config\") pod \"lws-controller-manager-6c77454567-nknh7\" (UID: \"be530a2b-62b9-41fb-8b65-d0089830df5d\") " pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" Jul 08 12:07:57.589849 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.589770 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/be530a2b-62b9-41fb-8b65-d0089830df5d-metrics-cert\") pod \"lws-controller-manager-6c77454567-nknh7\" (UID: \"be530a2b-62b9-41fb-8b65-d0089830df5d\") " pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" Jul 08 12:07:57.589943 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.589845 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be530a2b-62b9-41fb-8b65-d0089830df5d-cert\") pod \"lws-controller-manager-6c77454567-nknh7\" (UID: \"be530a2b-62b9-41fb-8b65-d0089830df5d\") " pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" Jul 08 12:07:57.589943 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.589907 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swrt5\" (UniqueName: \"kubernetes.io/projected/be530a2b-62b9-41fb-8b65-d0089830df5d-kube-api-access-swrt5\") pod \"lws-controller-manager-6c77454567-nknh7\" (UID: \"be530a2b-62b9-41fb-8b65-d0089830df5d\") " pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" Jul 08 12:07:57.597874 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.597839 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c77454567-nknh7"] Jul 08 12:07:57.691503 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.691453 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/be530a2b-62b9-41fb-8b65-d0089830df5d-manager-config\") pod \"lws-controller-manager-6c77454567-nknh7\" (UID: \"be530a2b-62b9-41fb-8b65-d0089830df5d\") " pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" Jul 08 12:07:57.691674 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.691552 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/be530a2b-62b9-41fb-8b65-d0089830df5d-metrics-cert\") pod \"lws-controller-manager-6c77454567-nknh7\" (UID: \"be530a2b-62b9-41fb-8b65-d0089830df5d\") " pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" Jul 08 12:07:57.691674 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.691616 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be530a2b-62b9-41fb-8b65-d0089830df5d-cert\") pod \"lws-controller-manager-6c77454567-nknh7\" (UID: \"be530a2b-62b9-41fb-8b65-d0089830df5d\") " pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" Jul 08 12:07:57.691674 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.691657 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swrt5\" (UniqueName: \"kubernetes.io/projected/be530a2b-62b9-41fb-8b65-d0089830df5d-kube-api-access-swrt5\") pod \"lws-controller-manager-6c77454567-nknh7\" (UID: \"be530a2b-62b9-41fb-8b65-d0089830df5d\") " pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" Jul 08 12:07:57.692577 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.692257 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/be530a2b-62b9-41fb-8b65-d0089830df5d-manager-config\") pod \"lws-controller-manager-6c77454567-nknh7\" (UID: \"be530a2b-62b9-41fb-8b65-d0089830df5d\") " pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" Jul 08 12:07:57.695089 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.695043 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be530a2b-62b9-41fb-8b65-d0089830df5d-cert\") pod \"lws-controller-manager-6c77454567-nknh7\" (UID: \"be530a2b-62b9-41fb-8b65-d0089830df5d\") " pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" Jul 08 12:07:57.701609 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.701262 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/be530a2b-62b9-41fb-8b65-d0089830df5d-metrics-cert\") pod \"lws-controller-manager-6c77454567-nknh7\" (UID: \"be530a2b-62b9-41fb-8b65-d0089830df5d\") " pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" Jul 08 12:07:57.704332 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.704285 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swrt5\" (UniqueName: \"kubernetes.io/projected/be530a2b-62b9-41fb-8b65-d0089830df5d-kube-api-access-swrt5\") pod \"lws-controller-manager-6c77454567-nknh7\" (UID: \"be530a2b-62b9-41fb-8b65-d0089830df5d\") " pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" Jul 08 12:07:57.706848 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.706816 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" event={"ID":"48751fbb-ce21-4b1b-a741-b0129b72b287","Type":"ContainerStarted","Data":"2e3c1bc515a6829fd8d6bd7ef4b0e71c08c8dae033627c612cffb344306e7ff0"} Jul 08 12:07:57.883869 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:57.883755 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" Jul 08 12:07:58.143442 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:58.143259 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c77454567-nknh7"] Jul 08 12:07:58.146517 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:07:58.146489 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe530a2b_62b9_41fb_8b65_d0089830df5d.slice/crio-96bad53cef9897a39d6d0875cbea1d4bfdc636c7274b0bf6c69a176f18de8e11 WatchSource:0}: Error finding container 96bad53cef9897a39d6d0875cbea1d4bfdc636c7274b0bf6c69a176f18de8e11: Status 404 returned error can't find the container with id 96bad53cef9897a39d6d0875cbea1d4bfdc636c7274b0bf6c69a176f18de8e11 Jul 08 12:07:58.715951 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:07:58.715873 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" event={"ID":"be530a2b-62b9-41fb-8b65-d0089830df5d","Type":"ContainerStarted","Data":"96bad53cef9897a39d6d0875cbea1d4bfdc636c7274b0bf6c69a176f18de8e11"} Jul 08 12:08:00.047880 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:00.047823 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 12:08:00.048201 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:00.047958 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 12:08:00.048201 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:00.047995 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 12:08:00.726839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:00.726806 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" event={"ID":"48751fbb-ce21-4b1b-a741-b0129b72b287","Type":"ContainerStarted","Data":"3ad1b91ade265ca78ce9456ae363f8bf3ab1e6183b7c6031ebd91a25bbc1ad10"} Jul 08 12:08:00.728325 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:00.728302 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" event={"ID":"be530a2b-62b9-41fb-8b65-d0089830df5d","Type":"ContainerStarted","Data":"50e92f10000f69ff4d11b32272c18100d9622b48a22486d0a7435d290b5b5d2d"} Jul 08 12:08:00.728466 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:00.728428 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" Jul 08 12:08:00.778386 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:00.778325 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" podStartSLOduration=1.7679752770000001 podStartE2EDuration="4.778306814s" totalImagesPullingTime="3.010331537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:08:00.777993517 +0000 UTC m=+392.137732826" watchObservedRunningTime="2026-07-08 12:08:00.778306814 +0000 UTC m=+392.138046120" Jul 08 12:08:00.831559 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:00.831504 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" podStartSLOduration=1.9326546260000002 podStartE2EDuration="3.831488033s" totalImagesPullingTime="1.898833407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:08:00.830040304 +0000 UTC m=+392.189779611" watchObservedRunningTime="2026-07-08 12:08:00.831488033 +0000 UTC m=+392.191227318" Jul 08 12:08:00.879129 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:00.879096 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:08:01.775920 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:01.775872 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:08:01.883882 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:01.883852 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:08:01.905087 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:01.905056 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:08:02.003271 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:02.003239 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:08:02.089201 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:02.089114 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:08:02.193531 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:02.193495 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:08:02.299196 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:02.299167 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:08:02.467513 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:02.467401 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:08:02.576774 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:02.576734 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:08:02.738263 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:02.738184 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:08:02.739056 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:02.739036 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mpnj4" Jul 08 12:08:05.694008 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:05.693982 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-694hd" Jul 08 12:08:05.695568 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:05.695547 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-f25kr" Jul 08 12:08:11.735190 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:11.735162 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c77454567-nknh7" Jul 08 12:08:32.659245 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:32.659212 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:08:49.318405 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:49.318362 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:08:49.419412 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:49.419378 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:08:49.523043 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:49.523013 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:08:50.264475 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:50.264430 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:08:50.467826 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:08:50.467791 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:01.660372 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:01.660296 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl"] Jul 08 12:09:01.664097 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:01.664077 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl" Jul 08 12:09:01.667045 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:01.667026 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 12:09:01.668097 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:01.668078 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2jxhl\"" Jul 08 12:09:01.668167 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:01.668083 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 12:09:01.673124 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:01.673098 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl"] Jul 08 12:09:01.742710 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:01.742678 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efa39d73-ef69-4b84-b40c-7b51aa7dae46-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl\" (UID: \"efa39d73-ef69-4b84-b40c-7b51aa7dae46\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl" Jul 08 12:09:01.742866 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:01.742719 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efa39d73-ef69-4b84-b40c-7b51aa7dae46-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl\" (UID: \"efa39d73-ef69-4b84-b40c-7b51aa7dae46\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl" Jul 08 12:09:01.742866 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:01.742790 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r8m8\" (UniqueName: \"kubernetes.io/projected/efa39d73-ef69-4b84-b40c-7b51aa7dae46-kube-api-access-7r8m8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl\" (UID: \"efa39d73-ef69-4b84-b40c-7b51aa7dae46\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl" Jul 08 12:09:01.843736 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:01.843693 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efa39d73-ef69-4b84-b40c-7b51aa7dae46-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl\" (UID: \"efa39d73-ef69-4b84-b40c-7b51aa7dae46\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl" Jul 08 12:09:01.843947 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:01.843860 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r8m8\" (UniqueName: \"kubernetes.io/projected/efa39d73-ef69-4b84-b40c-7b51aa7dae46-kube-api-access-7r8m8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl\" (UID: \"efa39d73-ef69-4b84-b40c-7b51aa7dae46\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl" Jul 08 12:09:01.844022 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:01.843977 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efa39d73-ef69-4b84-b40c-7b51aa7dae46-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl\" (UID: \"efa39d73-ef69-4b84-b40c-7b51aa7dae46\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl" Jul 08 12:09:01.844116 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:01.844096 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efa39d73-ef69-4b84-b40c-7b51aa7dae46-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl\" (UID: \"efa39d73-ef69-4b84-b40c-7b51aa7dae46\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl" Jul 08 12:09:01.844259 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:01.844242 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efa39d73-ef69-4b84-b40c-7b51aa7dae46-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl\" (UID: \"efa39d73-ef69-4b84-b40c-7b51aa7dae46\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl" Jul 08 12:09:01.854820 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:01.854792 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r8m8\" (UniqueName: \"kubernetes.io/projected/efa39d73-ef69-4b84-b40c-7b51aa7dae46-kube-api-access-7r8m8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl\" (UID: \"efa39d73-ef69-4b84-b40c-7b51aa7dae46\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl" Jul 08 12:09:01.974034 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:01.973955 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl" Jul 08 12:09:02.112963 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.112939 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl"] Jul 08 12:09:02.115079 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:09:02.115054 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefa39d73_ef69_4b84_b40c_7b51aa7dae46.slice/crio-a52c95935816b0ea1f4797e81f9192c2e55b755bbee355e3041cd4f86dc77f1f WatchSource:0}: Error finding container a52c95935816b0ea1f4797e81f9192c2e55b755bbee355e3041cd4f86dc77f1f: Status 404 returned error can't find the container with id a52c95935816b0ea1f4797e81f9192c2e55b755bbee355e3041cd4f86dc77f1f Jul 08 12:09:02.264957 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.264927 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc"] Jul 08 12:09:02.268491 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.268473 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" Jul 08 12:09:02.280347 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.280321 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc"] Jul 08 12:09:02.349968 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.349935 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4zsq\" (UniqueName: \"kubernetes.io/projected/49de7306-7c31-4fa1-b9d3-3aec7a57f7d2-kube-api-access-c4zsq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc\" (UID: \"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" Jul 08 12:09:02.350138 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.350002 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49de7306-7c31-4fa1-b9d3-3aec7a57f7d2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc\" (UID: \"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" Jul 08 12:09:02.350138 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.350069 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49de7306-7c31-4fa1-b9d3-3aec7a57f7d2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc\" (UID: \"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" Jul 08 12:09:02.451474 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.451438 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49de7306-7c31-4fa1-b9d3-3aec7a57f7d2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc\" (UID: \"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" Jul 08 12:09:02.451642 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.451488 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4zsq\" (UniqueName: \"kubernetes.io/projected/49de7306-7c31-4fa1-b9d3-3aec7a57f7d2-kube-api-access-c4zsq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc\" (UID: \"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" Jul 08 12:09:02.451642 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.451534 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49de7306-7c31-4fa1-b9d3-3aec7a57f7d2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc\" (UID: \"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" Jul 08 12:09:02.451957 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.451900 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49de7306-7c31-4fa1-b9d3-3aec7a57f7d2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc\" (UID: \"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" Jul 08 12:09:02.451998 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.451900 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49de7306-7c31-4fa1-b9d3-3aec7a57f7d2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc\" (UID: \"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" Jul 08 12:09:02.461023 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.460998 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4zsq\" (UniqueName: \"kubernetes.io/projected/49de7306-7c31-4fa1-b9d3-3aec7a57f7d2-kube-api-access-c4zsq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc\" (UID: \"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" Jul 08 12:09:02.585893 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.585813 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" Jul 08 12:09:02.718930 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.718893 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc"] Jul 08 12:09:02.719863 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:09:02.719835 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49de7306_7c31_4fa1_b9d3_3aec7a57f7d2.slice/crio-accb8e2117b8e22eb9a4b65fbf22ea41d3d3dd32f09a2740e998df1b4ffe3d45 WatchSource:0}: Error finding container accb8e2117b8e22eb9a4b65fbf22ea41d3d3dd32f09a2740e998df1b4ffe3d45: Status 404 returned error can't find the container with id accb8e2117b8e22eb9a4b65fbf22ea41d3d3dd32f09a2740e998df1b4ffe3d45 Jul 08 12:09:02.862545 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.862478 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn"] Jul 08 12:09:02.867300 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.867282 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn" Jul 08 12:09:02.876353 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.876323 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn"] Jul 08 12:09:02.955542 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.955508 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68xm4\" (UniqueName: \"kubernetes.io/projected/ae6e7c25-d0f2-4a43-83d8-367eac7928c4-kube-api-access-68xm4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn\" (UID: \"ae6e7c25-d0f2-4a43-83d8-367eac7928c4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn" Jul 08 12:09:02.955542 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.955547 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae6e7c25-d0f2-4a43-83d8-367eac7928c4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn\" (UID: \"ae6e7c25-d0f2-4a43-83d8-367eac7928c4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn" Jul 08 12:09:02.955783 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:02.955613 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae6e7c25-d0f2-4a43-83d8-367eac7928c4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn\" (UID: \"ae6e7c25-d0f2-4a43-83d8-367eac7928c4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn" Jul 08 12:09:03.036610 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.036577 2560 generic.go:356] "Generic (PLEG): container finished" podID="49de7306-7c31-4fa1-b9d3-3aec7a57f7d2" containerID="276b2615e27b4408274e80c8657e6164dc14c03e7187a965a3499121fc6f7635" exitCode=0 Jul 08 12:09:03.036809 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.036666 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" event={"ID":"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2","Type":"ContainerDied","Data":"276b2615e27b4408274e80c8657e6164dc14c03e7187a965a3499121fc6f7635"} Jul 08 12:09:03.036809 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.036717 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" event={"ID":"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2","Type":"ContainerStarted","Data":"accb8e2117b8e22eb9a4b65fbf22ea41d3d3dd32f09a2740e998df1b4ffe3d45"} Jul 08 12:09:03.038335 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.038310 2560 generic.go:356] "Generic (PLEG): container finished" podID="efa39d73-ef69-4b84-b40c-7b51aa7dae46" containerID="c23016f362248acc45a4013cf1037afd3b00e8ade45f9b9933a2a82d7d91cb81" exitCode=0 Jul 08 12:09:03.038408 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.038360 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl" event={"ID":"efa39d73-ef69-4b84-b40c-7b51aa7dae46","Type":"ContainerDied","Data":"c23016f362248acc45a4013cf1037afd3b00e8ade45f9b9933a2a82d7d91cb81"} Jul 08 12:09:03.038408 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.038404 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl" event={"ID":"efa39d73-ef69-4b84-b40c-7b51aa7dae46","Type":"ContainerStarted","Data":"a52c95935816b0ea1f4797e81f9192c2e55b755bbee355e3041cd4f86dc77f1f"} Jul 08 12:09:03.056346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.056325 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68xm4\" (UniqueName: \"kubernetes.io/projected/ae6e7c25-d0f2-4a43-83d8-367eac7928c4-kube-api-access-68xm4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn\" (UID: \"ae6e7c25-d0f2-4a43-83d8-367eac7928c4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn" Jul 08 12:09:03.056443 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.056354 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae6e7c25-d0f2-4a43-83d8-367eac7928c4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn\" (UID: \"ae6e7c25-d0f2-4a43-83d8-367eac7928c4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn" Jul 08 12:09:03.056443 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.056387 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae6e7c25-d0f2-4a43-83d8-367eac7928c4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn\" (UID: \"ae6e7c25-d0f2-4a43-83d8-367eac7928c4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn" Jul 08 12:09:03.056717 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.056703 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae6e7c25-d0f2-4a43-83d8-367eac7928c4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn\" (UID: \"ae6e7c25-d0f2-4a43-83d8-367eac7928c4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn" Jul 08 12:09:03.056753 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.056738 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae6e7c25-d0f2-4a43-83d8-367eac7928c4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn\" (UID: \"ae6e7c25-d0f2-4a43-83d8-367eac7928c4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn" Jul 08 12:09:03.065622 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.065600 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68xm4\" (UniqueName: \"kubernetes.io/projected/ae6e7c25-d0f2-4a43-83d8-367eac7928c4-kube-api-access-68xm4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn\" (UID: \"ae6e7c25-d0f2-4a43-83d8-367eac7928c4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn" Jul 08 12:09:03.192727 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.192650 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn" Jul 08 12:09:03.328493 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.328469 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn"] Jul 08 12:09:03.330359 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:09:03.330330 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae6e7c25_d0f2_4a43_83d8_367eac7928c4.slice/crio-5edaa77d32bd4e5d3435a7ae615cee714526aa635e31fa23fe9eaad3ac5021a5 WatchSource:0}: Error finding container 5edaa77d32bd4e5d3435a7ae615cee714526aa635e31fa23fe9eaad3ac5021a5: Status 404 returned error can't find the container with id 5edaa77d32bd4e5d3435a7ae615cee714526aa635e31fa23fe9eaad3ac5021a5 Jul 08 12:09:03.462990 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.462892 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb"] Jul 08 12:09:03.466581 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.466558 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb" Jul 08 12:09:03.476382 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.476356 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb"] Jul 08 12:09:03.561767 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.561739 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mhft\" (UniqueName: \"kubernetes.io/projected/f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a-kube-api-access-8mhft\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb\" (UID: \"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb" Jul 08 12:09:03.561975 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.561778 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb\" (UID: \"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb" Jul 08 12:09:03.561975 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.561858 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb\" (UID: \"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb" Jul 08 12:09:03.663254 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.663224 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb\" (UID: \"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb" Jul 08 12:09:03.663437 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.663259 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mhft\" (UniqueName: \"kubernetes.io/projected/f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a-kube-api-access-8mhft\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb\" (UID: \"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb" Jul 08 12:09:03.663437 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.663289 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb\" (UID: \"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb" Jul 08 12:09:03.663641 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.663600 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb\" (UID: \"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb" Jul 08 12:09:03.663641 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.663604 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb\" (UID: \"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb" Jul 08 12:09:03.673456 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.673430 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mhft\" (UniqueName: \"kubernetes.io/projected/f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a-kube-api-access-8mhft\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb\" (UID: \"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb" Jul 08 12:09:03.800142 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:03.800112 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb" Jul 08 12:09:04.042566 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:04.042545 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb"] Jul 08 12:09:04.045004 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:09:04.044975 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf236bef4_4363_4e1e_b3fd_7f5d8fe23b9a.slice/crio-8cf1b9f8527c985b83afe45a4eb17a2a560dee1e9fb07701dfacba96743e2571 WatchSource:0}: Error finding container 8cf1b9f8527c985b83afe45a4eb17a2a560dee1e9fb07701dfacba96743e2571: Status 404 returned error can't find the container with id 8cf1b9f8527c985b83afe45a4eb17a2a560dee1e9fb07701dfacba96743e2571 Jul 08 12:09:04.045754 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:04.045722 2560 generic.go:356] "Generic (PLEG): container finished" podID="ae6e7c25-d0f2-4a43-83d8-367eac7928c4" containerID="0f8932e6a92bdb69cc4c0fa5857cb5f7a0e5d024c7c51dba15bf37de5e6f8415" exitCode=0 Jul 08 12:09:04.045861 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:04.045815 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn" event={"ID":"ae6e7c25-d0f2-4a43-83d8-367eac7928c4","Type":"ContainerDied","Data":"0f8932e6a92bdb69cc4c0fa5857cb5f7a0e5d024c7c51dba15bf37de5e6f8415"} Jul 08 12:09:04.046022 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:04.045889 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn" event={"ID":"ae6e7c25-d0f2-4a43-83d8-367eac7928c4","Type":"ContainerStarted","Data":"5edaa77d32bd4e5d3435a7ae615cee714526aa635e31fa23fe9eaad3ac5021a5"} Jul 08 12:09:04.048124 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:04.048098 2560 generic.go:356] "Generic (PLEG): container finished" podID="efa39d73-ef69-4b84-b40c-7b51aa7dae46" containerID="33a1fd32c117fb08ad7acdc70435a845ce97a34ca3b46cba8befbafef72fb670" exitCode=0 Jul 08 12:09:04.048230 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:04.048134 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl" event={"ID":"efa39d73-ef69-4b84-b40c-7b51aa7dae46","Type":"ContainerDied","Data":"33a1fd32c117fb08ad7acdc70435a845ce97a34ca3b46cba8befbafef72fb670"} Jul 08 12:09:04.050352 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:04.050328 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" event={"ID":"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2","Type":"ContainerStarted","Data":"28ce6a392728148aa286319d9d7771537772b5a3a009deecacbeaacda95786d9"} Jul 08 12:09:05.057714 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:05.057678 2560 generic.go:356] "Generic (PLEG): container finished" podID="ae6e7c25-d0f2-4a43-83d8-367eac7928c4" containerID="b27841a76541d9ad6bebdacf2955b25fc847b9e36268b0f4f808c5f05184d2dd" exitCode=0 Jul 08 12:09:05.058150 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:05.057769 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn" event={"ID":"ae6e7c25-d0f2-4a43-83d8-367eac7928c4","Type":"ContainerDied","Data":"b27841a76541d9ad6bebdacf2955b25fc847b9e36268b0f4f808c5f05184d2dd"} Jul 08 12:09:05.060061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:05.060040 2560 generic.go:356] "Generic (PLEG): container finished" podID="efa39d73-ef69-4b84-b40c-7b51aa7dae46" containerID="4daad9ef750253ab72d92b45244f49bac57ccfbbf24cc05860453a76205f19f3" exitCode=0 Jul 08 12:09:05.060150 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:05.060122 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl" event={"ID":"efa39d73-ef69-4b84-b40c-7b51aa7dae46","Type":"ContainerDied","Data":"4daad9ef750253ab72d92b45244f49bac57ccfbbf24cc05860453a76205f19f3"} Jul 08 12:09:05.061838 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:05.061819 2560 generic.go:356] "Generic (PLEG): container finished" podID="49de7306-7c31-4fa1-b9d3-3aec7a57f7d2" containerID="28ce6a392728148aa286319d9d7771537772b5a3a009deecacbeaacda95786d9" exitCode=0 Jul 08 12:09:05.061953 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:05.061885 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" event={"ID":"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2","Type":"ContainerDied","Data":"28ce6a392728148aa286319d9d7771537772b5a3a009deecacbeaacda95786d9"} Jul 08 12:09:05.063397 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:05.063376 2560 generic.go:356] "Generic (PLEG): container finished" podID="f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a" containerID="f348ca66fb2df44503acc35f4d69f2765b0a284d38e93a00e8793d91f6f0690a" exitCode=0 Jul 08 12:09:05.063480 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:05.063413 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb" event={"ID":"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a","Type":"ContainerDied","Data":"f348ca66fb2df44503acc35f4d69f2765b0a284d38e93a00e8793d91f6f0690a"} Jul 08 12:09:05.063480 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:05.063453 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb" event={"ID":"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a","Type":"ContainerStarted","Data":"8cf1b9f8527c985b83afe45a4eb17a2a560dee1e9fb07701dfacba96743e2571"} Jul 08 12:09:06.070648 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:06.070610 2560 generic.go:356] "Generic (PLEG): container finished" podID="49de7306-7c31-4fa1-b9d3-3aec7a57f7d2" containerID="52b9ff9c83c1ff91d5d92ceebc286463f16d7a2e7daeabc2fb2497c7f0fa55e7" exitCode=0 Jul 08 12:09:06.071057 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:06.070699 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" event={"ID":"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2","Type":"ContainerDied","Data":"52b9ff9c83c1ff91d5d92ceebc286463f16d7a2e7daeabc2fb2497c7f0fa55e7"} Jul 08 12:09:06.072483 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:06.072462 2560 generic.go:356] "Generic (PLEG): container finished" podID="f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a" containerID="1b8766e4bc56978cd5e3efe1e1ff844d5d341c527c48ceced22103e03be82c22" exitCode=0 Jul 08 12:09:06.072602 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:06.072528 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb" event={"ID":"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a","Type":"ContainerDied","Data":"1b8766e4bc56978cd5e3efe1e1ff844d5d341c527c48ceced22103e03be82c22"} Jul 08 12:09:06.074604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:06.074581 2560 generic.go:356] "Generic (PLEG): container finished" podID="ae6e7c25-d0f2-4a43-83d8-367eac7928c4" containerID="36d8fa23ba5b2a28ee516bb4654529d282c0a6da900d0326e5e0c25f2067f217" exitCode=0 Jul 08 12:09:06.074702 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:06.074647 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn" event={"ID":"ae6e7c25-d0f2-4a43-83d8-367eac7928c4","Type":"ContainerDied","Data":"36d8fa23ba5b2a28ee516bb4654529d282c0a6da900d0326e5e0c25f2067f217"} Jul 08 12:09:06.202760 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:06.202735 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl" Jul 08 12:09:06.292804 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:06.292776 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7r8m8\" (UniqueName: \"kubernetes.io/projected/efa39d73-ef69-4b84-b40c-7b51aa7dae46-kube-api-access-7r8m8\") pod \"efa39d73-ef69-4b84-b40c-7b51aa7dae46\" (UID: \"efa39d73-ef69-4b84-b40c-7b51aa7dae46\") " Jul 08 12:09:06.292958 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:06.292821 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efa39d73-ef69-4b84-b40c-7b51aa7dae46-bundle\") pod \"efa39d73-ef69-4b84-b40c-7b51aa7dae46\" (UID: \"efa39d73-ef69-4b84-b40c-7b51aa7dae46\") " Jul 08 12:09:06.292958 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:06.292908 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efa39d73-ef69-4b84-b40c-7b51aa7dae46-util\") pod \"efa39d73-ef69-4b84-b40c-7b51aa7dae46\" (UID: \"efa39d73-ef69-4b84-b40c-7b51aa7dae46\") " Jul 08 12:09:06.293380 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:06.293343 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efa39d73-ef69-4b84-b40c-7b51aa7dae46-bundle" (OuterVolumeSpecName: "bundle") pod "efa39d73-ef69-4b84-b40c-7b51aa7dae46" (UID: "efa39d73-ef69-4b84-b40c-7b51aa7dae46"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:09:06.295002 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:06.294976 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efa39d73-ef69-4b84-b40c-7b51aa7dae46-kube-api-access-7r8m8" (OuterVolumeSpecName: "kube-api-access-7r8m8") pod "efa39d73-ef69-4b84-b40c-7b51aa7dae46" (UID: "efa39d73-ef69-4b84-b40c-7b51aa7dae46"). InnerVolumeSpecName "kube-api-access-7r8m8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:09:06.298580 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:06.298556 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efa39d73-ef69-4b84-b40c-7b51aa7dae46-util" (OuterVolumeSpecName: "util") pod "efa39d73-ef69-4b84-b40c-7b51aa7dae46" (UID: "efa39d73-ef69-4b84-b40c-7b51aa7dae46"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:09:06.394432 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:06.394345 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efa39d73-ef69-4b84-b40c-7b51aa7dae46-bundle\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:09:06.394432 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:06.394377 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efa39d73-ef69-4b84-b40c-7b51aa7dae46-util\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:09:06.394432 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:06.394387 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r8m8\" (UniqueName: \"kubernetes.io/projected/efa39d73-ef69-4b84-b40c-7b51aa7dae46-kube-api-access-7r8m8\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:09:07.081654 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.081623 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl" Jul 08 12:09:07.082155 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.081651 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl" event={"ID":"efa39d73-ef69-4b84-b40c-7b51aa7dae46","Type":"ContainerDied","Data":"a52c95935816b0ea1f4797e81f9192c2e55b755bbee355e3041cd4f86dc77f1f"} Jul 08 12:09:07.082155 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.081732 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a52c95935816b0ea1f4797e81f9192c2e55b755bbee355e3041cd4f86dc77f1f" Jul 08 12:09:07.083824 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.083797 2560 generic.go:356] "Generic (PLEG): container finished" podID="f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a" containerID="b4fca2f0fa80d11dc8905aa336b6893cadf84bab53d118bf6769ad429fec0b6b" exitCode=0 Jul 08 12:09:07.083984 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.083875 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb" event={"ID":"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a","Type":"ContainerDied","Data":"b4fca2f0fa80d11dc8905aa336b6893cadf84bab53d118bf6769ad429fec0b6b"} Jul 08 12:09:07.223743 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.223718 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" Jul 08 12:09:07.253083 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.253058 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn" Jul 08 12:09:07.301081 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.301055 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49de7306-7c31-4fa1-b9d3-3aec7a57f7d2-util\") pod \"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2\" (UID: \"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2\") " Jul 08 12:09:07.301265 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.301139 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49de7306-7c31-4fa1-b9d3-3aec7a57f7d2-bundle\") pod \"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2\" (UID: \"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2\") " Jul 08 12:09:07.301265 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.301156 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae6e7c25-d0f2-4a43-83d8-367eac7928c4-util\") pod \"ae6e7c25-d0f2-4a43-83d8-367eac7928c4\" (UID: \"ae6e7c25-d0f2-4a43-83d8-367eac7928c4\") " Jul 08 12:09:07.301265 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.301183 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68xm4\" (UniqueName: \"kubernetes.io/projected/ae6e7c25-d0f2-4a43-83d8-367eac7928c4-kube-api-access-68xm4\") pod \"ae6e7c25-d0f2-4a43-83d8-367eac7928c4\" (UID: \"ae6e7c25-d0f2-4a43-83d8-367eac7928c4\") " Jul 08 12:09:07.301265 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.301230 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4zsq\" (UniqueName: \"kubernetes.io/projected/49de7306-7c31-4fa1-b9d3-3aec7a57f7d2-kube-api-access-c4zsq\") pod \"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2\" (UID: \"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2\") " Jul 08 12:09:07.301471 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.301275 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae6e7c25-d0f2-4a43-83d8-367eac7928c4-bundle\") pod \"ae6e7c25-d0f2-4a43-83d8-367eac7928c4\" (UID: \"ae6e7c25-d0f2-4a43-83d8-367eac7928c4\") " Jul 08 12:09:07.301737 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.301705 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49de7306-7c31-4fa1-b9d3-3aec7a57f7d2-bundle" (OuterVolumeSpecName: "bundle") pod "49de7306-7c31-4fa1-b9d3-3aec7a57f7d2" (UID: "49de7306-7c31-4fa1-b9d3-3aec7a57f7d2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:09:07.302088 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.302058 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae6e7c25-d0f2-4a43-83d8-367eac7928c4-bundle" (OuterVolumeSpecName: "bundle") pod "ae6e7c25-d0f2-4a43-83d8-367eac7928c4" (UID: "ae6e7c25-d0f2-4a43-83d8-367eac7928c4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:09:07.303457 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.303421 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49de7306-7c31-4fa1-b9d3-3aec7a57f7d2-kube-api-access-c4zsq" (OuterVolumeSpecName: "kube-api-access-c4zsq") pod "49de7306-7c31-4fa1-b9d3-3aec7a57f7d2" (UID: "49de7306-7c31-4fa1-b9d3-3aec7a57f7d2"). InnerVolumeSpecName "kube-api-access-c4zsq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:09:07.303613 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.303592 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae6e7c25-d0f2-4a43-83d8-367eac7928c4-kube-api-access-68xm4" (OuterVolumeSpecName: "kube-api-access-68xm4") pod "ae6e7c25-d0f2-4a43-83d8-367eac7928c4" (UID: "ae6e7c25-d0f2-4a43-83d8-367eac7928c4"). InnerVolumeSpecName "kube-api-access-68xm4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:09:07.306869 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.306847 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae6e7c25-d0f2-4a43-83d8-367eac7928c4-util" (OuterVolumeSpecName: "util") pod "ae6e7c25-d0f2-4a43-83d8-367eac7928c4" (UID: "ae6e7c25-d0f2-4a43-83d8-367eac7928c4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:09:07.307735 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.307715 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49de7306-7c31-4fa1-b9d3-3aec7a57f7d2-util" (OuterVolumeSpecName: "util") pod "49de7306-7c31-4fa1-b9d3-3aec7a57f7d2" (UID: "49de7306-7c31-4fa1-b9d3-3aec7a57f7d2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:09:07.402334 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.402251 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae6e7c25-d0f2-4a43-83d8-367eac7928c4-bundle\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:09:07.402334 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.402280 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49de7306-7c31-4fa1-b9d3-3aec7a57f7d2-util\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:09:07.402334 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.402289 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49de7306-7c31-4fa1-b9d3-3aec7a57f7d2-bundle\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:09:07.402334 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.402296 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae6e7c25-d0f2-4a43-83d8-367eac7928c4-util\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:09:07.402334 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.402304 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68xm4\" (UniqueName: \"kubernetes.io/projected/ae6e7c25-d0f2-4a43-83d8-367eac7928c4-kube-api-access-68xm4\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:09:07.402334 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:07.402316 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4zsq\" (UniqueName: \"kubernetes.io/projected/49de7306-7c31-4fa1-b9d3-3aec7a57f7d2-kube-api-access-c4zsq\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:09:08.090872 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:08.090841 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn" Jul 08 12:09:08.090872 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:08.090858 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn" event={"ID":"ae6e7c25-d0f2-4a43-83d8-367eac7928c4","Type":"ContainerDied","Data":"5edaa77d32bd4e5d3435a7ae615cee714526aa635e31fa23fe9eaad3ac5021a5"} Jul 08 12:09:08.091395 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:08.090903 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5edaa77d32bd4e5d3435a7ae615cee714526aa635e31fa23fe9eaad3ac5021a5" Jul 08 12:09:08.092845 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:08.092813 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" event={"ID":"49de7306-7c31-4fa1-b9d3-3aec7a57f7d2","Type":"ContainerDied","Data":"accb8e2117b8e22eb9a4b65fbf22ea41d3d3dd32f09a2740e998df1b4ffe3d45"} Jul 08 12:09:08.092845 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:08.092831 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc" Jul 08 12:09:08.092998 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:08.092854 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="accb8e2117b8e22eb9a4b65fbf22ea41d3d3dd32f09a2740e998df1b4ffe3d45" Jul 08 12:09:08.220845 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:08.220822 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb" Jul 08 12:09:08.310051 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:08.310020 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a-bundle\") pod \"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a\" (UID: \"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a\") " Jul 08 12:09:08.310214 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:08.310112 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mhft\" (UniqueName: \"kubernetes.io/projected/f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a-kube-api-access-8mhft\") pod \"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a\" (UID: \"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a\") " Jul 08 12:09:08.310214 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:08.310144 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a-util\") pod \"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a\" (UID: \"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a\") " Jul 08 12:09:08.310674 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:08.310643 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a-bundle" (OuterVolumeSpecName: "bundle") pod "f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a" (UID: "f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:09:08.312216 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:08.312191 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a-kube-api-access-8mhft" (OuterVolumeSpecName: "kube-api-access-8mhft") pod "f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a" (UID: "f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a"). InnerVolumeSpecName "kube-api-access-8mhft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:09:08.315564 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:08.315544 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a-util" (OuterVolumeSpecName: "util") pod "f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a" (UID: "f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:09:08.411360 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:08.411282 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mhft\" (UniqueName: \"kubernetes.io/projected/f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a-kube-api-access-8mhft\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:09:08.411360 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:08.411310 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a-util\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:09:08.411360 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:08.411320 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a-bundle\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:09:09.099471 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:09.099438 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb" event={"ID":"f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a","Type":"ContainerDied","Data":"8cf1b9f8527c985b83afe45a4eb17a2a560dee1e9fb07701dfacba96743e2571"} Jul 08 12:09:09.099471 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:09.099471 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb" Jul 08 12:09:09.099892 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:09.099485 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cf1b9f8527c985b83afe45a4eb17a2a560dee1e9fb07701dfacba96743e2571" Jul 08 12:09:14.998233 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:14.998196 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:15.584299 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:15.584265 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:16.616438 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:16.616408 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:16.715663 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:16.715628 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:19.784655 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:19.784616 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:19.885088 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:19.885057 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:23.201212 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:23.201154 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:25.205775 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:25.205735 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:25.423837 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:25.423805 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:27.824267 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:27.824226 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:28.993691 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:28.993631 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:29.053840 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:29.053794 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:29.397624 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:29.397574 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:29.498726 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:29.498684 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:30.131519 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:30.131483 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:30.215196 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:30.215158 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:32.617562 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:32.617524 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:32.713115 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:32.713070 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:33.005505 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:33.005407 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:33.108221 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:33.108192 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:40.106112 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:40.106035 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:40.161696 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:40.161659 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:40.682070 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:40.682035 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-89794f788-rfm65"] Jul 08 12:09:40.808733 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:40.808699 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:40.909829 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:40.909796 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:40.969053 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:40.968962 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:44.874303 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:44.874268 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:44.974757 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:44.974716 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:48.632112 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:48.632077 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:48.736618 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:48.736584 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:48.855110 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:48.855073 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:48.947028 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:48.946948 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:51.372318 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:51.372275 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:51.476218 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:51.476189 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:57.867985 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:57.867951 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:09:57.936711 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:09:57.936668 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:02.618108 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:02.618071 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:02.717929 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:02.717886 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:05.702734 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:05.702668 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-89794f788-rfm65" podUID="8c475865-8b38-43f7-8a04-7d131f351faa" containerName="console" containerID="cri-o://69ebc635c1fac8ebd97e1fac4a583ecbefb61d5d3346d8f80257d9f7617f98eb" gracePeriod=15 Jul 08 12:10:05.950583 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:05.950560 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89794f788-rfm65" Jul 08 12:10:06.019624 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.019588 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c475865-8b38-43f7-8a04-7d131f351faa-console-oauth-config\") pod \"8c475865-8b38-43f7-8a04-7d131f351faa\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " Jul 08 12:10:06.019817 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.019629 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-service-ca\") pod \"8c475865-8b38-43f7-8a04-7d131f351faa\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " Jul 08 12:10:06.019817 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.019660 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-oauth-serving-cert\") pod \"8c475865-8b38-43f7-8a04-7d131f351faa\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " Jul 08 12:10:06.019817 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.019695 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-console-config\") pod \"8c475865-8b38-43f7-8a04-7d131f351faa\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " Jul 08 12:10:06.019817 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.019735 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-trusted-ca-bundle\") pod \"8c475865-8b38-43f7-8a04-7d131f351faa\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " Jul 08 12:10:06.019817 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.019757 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c475865-8b38-43f7-8a04-7d131f351faa-console-serving-cert\") pod \"8c475865-8b38-43f7-8a04-7d131f351faa\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " Jul 08 12:10:06.020097 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.019842 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st7fv\" (UniqueName: \"kubernetes.io/projected/8c475865-8b38-43f7-8a04-7d131f351faa-kube-api-access-st7fv\") pod \"8c475865-8b38-43f7-8a04-7d131f351faa\" (UID: \"8c475865-8b38-43f7-8a04-7d131f351faa\") " Jul 08 12:10:06.020148 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.020119 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-service-ca" (OuterVolumeSpecName: "service-ca") pod "8c475865-8b38-43f7-8a04-7d131f351faa" (UID: "8c475865-8b38-43f7-8a04-7d131f351faa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 12:10:06.020188 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.020154 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8c475865-8b38-43f7-8a04-7d131f351faa" (UID: "8c475865-8b38-43f7-8a04-7d131f351faa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 12:10:06.020222 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.020178 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-console-config" (OuterVolumeSpecName: "console-config") pod "8c475865-8b38-43f7-8a04-7d131f351faa" (UID: "8c475865-8b38-43f7-8a04-7d131f351faa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 12:10:06.020256 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.020223 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8c475865-8b38-43f7-8a04-7d131f351faa" (UID: "8c475865-8b38-43f7-8a04-7d131f351faa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 12:10:06.021760 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.021736 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c475865-8b38-43f7-8a04-7d131f351faa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8c475865-8b38-43f7-8a04-7d131f351faa" (UID: "8c475865-8b38-43f7-8a04-7d131f351faa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 12:10:06.022050 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.022027 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c475865-8b38-43f7-8a04-7d131f351faa-kube-api-access-st7fv" (OuterVolumeSpecName: "kube-api-access-st7fv") pod "8c475865-8b38-43f7-8a04-7d131f351faa" (UID: "8c475865-8b38-43f7-8a04-7d131f351faa"). InnerVolumeSpecName "kube-api-access-st7fv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:10:06.022215 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.022192 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c475865-8b38-43f7-8a04-7d131f351faa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8c475865-8b38-43f7-8a04-7d131f351faa" (UID: "8c475865-8b38-43f7-8a04-7d131f351faa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 12:10:06.121530 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.121490 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c475865-8b38-43f7-8a04-7d131f351faa-console-serving-cert\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:10:06.121530 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.121523 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st7fv\" (UniqueName: \"kubernetes.io/projected/8c475865-8b38-43f7-8a04-7d131f351faa-kube-api-access-st7fv\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:10:06.121530 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.121535 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c475865-8b38-43f7-8a04-7d131f351faa-console-oauth-config\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:10:06.121530 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.121546 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-service-ca\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:10:06.121809 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.121554 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-oauth-serving-cert\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:10:06.121809 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.121563 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-console-config\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:10:06.121809 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.121570 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c475865-8b38-43f7-8a04-7d131f351faa-trusted-ca-bundle\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:10:06.388161 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.388074 2560 generic.go:356] "Generic (PLEG): container finished" podID="8c475865-8b38-43f7-8a04-7d131f351faa" containerID="69ebc635c1fac8ebd97e1fac4a583ecbefb61d5d3346d8f80257d9f7617f98eb" exitCode=0 Jul 08 12:10:06.388161 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.388128 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89794f788-rfm65" Jul 08 12:10:06.388395 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.388154 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89794f788-rfm65" event={"ID":"8c475865-8b38-43f7-8a04-7d131f351faa","Type":"ContainerDied","Data":"69ebc635c1fac8ebd97e1fac4a583ecbefb61d5d3346d8f80257d9f7617f98eb"} Jul 08 12:10:06.388395 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.388222 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89794f788-rfm65" event={"ID":"8c475865-8b38-43f7-8a04-7d131f351faa","Type":"ContainerDied","Data":"e5023c128611720e47eb7d1e32f8d6f737fff7806a2d12397ed4ef35d3d62da9"} Jul 08 12:10:06.388395 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.388250 2560 scope.go:117] "RemoveContainer" containerID="69ebc635c1fac8ebd97e1fac4a583ecbefb61d5d3346d8f80257d9f7617f98eb" Jul 08 12:10:06.398537 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.398521 2560 scope.go:117] "RemoveContainer" containerID="69ebc635c1fac8ebd97e1fac4a583ecbefb61d5d3346d8f80257d9f7617f98eb" Jul 08 12:10:06.398798 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:10:06.398779 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69ebc635c1fac8ebd97e1fac4a583ecbefb61d5d3346d8f80257d9f7617f98eb\": container with ID starting with 69ebc635c1fac8ebd97e1fac4a583ecbefb61d5d3346d8f80257d9f7617f98eb not found: ID does not exist" containerID="69ebc635c1fac8ebd97e1fac4a583ecbefb61d5d3346d8f80257d9f7617f98eb" Jul 08 12:10:06.398948 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.398807 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69ebc635c1fac8ebd97e1fac4a583ecbefb61d5d3346d8f80257d9f7617f98eb"} err="failed to get container status \"69ebc635c1fac8ebd97e1fac4a583ecbefb61d5d3346d8f80257d9f7617f98eb\": rpc error: code = NotFound desc = could not find container \"69ebc635c1fac8ebd97e1fac4a583ecbefb61d5d3346d8f80257d9f7617f98eb\": container with ID starting with 69ebc635c1fac8ebd97e1fac4a583ecbefb61d5d3346d8f80257d9f7617f98eb not found: ID does not exist" Jul 08 12:10:06.411427 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.411395 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-89794f788-rfm65"] Jul 08 12:10:06.413340 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.413321 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-89794f788-rfm65"] Jul 08 12:10:06.419114 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.419078 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:06.479076 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:06.479045 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:07.028924 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:07.028866 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:07.132642 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:07.132615 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c475865-8b38-43f7-8a04-7d131f351faa" path="/var/lib/kubelet/pods/8c475865-8b38-43f7-8a04-7d131f351faa/volumes" Jul 08 12:10:07.139292 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:07.139262 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:10.830200 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:10.830133 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:10.931612 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:10.931570 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:16.881813 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:16.881775 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:16.980874 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:16.980839 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:19.383299 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:19.383252 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:19.591187 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:19.591154 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:21.200695 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:21.200653 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:21.313820 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:21.313745 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:21.373686 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:21.373652 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:21.640596 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:21.640556 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:21.708587 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:21.708556 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:22.162061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162022 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-dw4hb"] Jul 08 12:10:22.162504 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162489 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c475865-8b38-43f7-8a04-7d131f351faa" containerName="console" Jul 08 12:10:22.162549 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162507 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c475865-8b38-43f7-8a04-7d131f351faa" containerName="console" Jul 08 12:10:22.162549 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162516 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae6e7c25-d0f2-4a43-83d8-367eac7928c4" containerName="util" Jul 08 12:10:22.162549 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162521 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae6e7c25-d0f2-4a43-83d8-367eac7928c4" containerName="util" Jul 08 12:10:22.162549 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162530 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa39d73-ef69-4b84-b40c-7b51aa7dae46" containerName="pull" Jul 08 12:10:22.162549 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162536 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa39d73-ef69-4b84-b40c-7b51aa7dae46" containerName="pull" Jul 08 12:10:22.162549 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162547 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49de7306-7c31-4fa1-b9d3-3aec7a57f7d2" containerName="pull" Jul 08 12:10:22.162549 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162552 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="49de7306-7c31-4fa1-b9d3-3aec7a57f7d2" containerName="pull" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162560 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a" containerName="extract" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162565 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a" containerName="extract" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162573 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a" containerName="pull" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162578 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a" containerName="pull" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162585 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae6e7c25-d0f2-4a43-83d8-367eac7928c4" containerName="pull" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162590 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae6e7c25-d0f2-4a43-83d8-367eac7928c4" containerName="pull" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162597 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49de7306-7c31-4fa1-b9d3-3aec7a57f7d2" containerName="extract" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162601 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="49de7306-7c31-4fa1-b9d3-3aec7a57f7d2" containerName="extract" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162614 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa39d73-ef69-4b84-b40c-7b51aa7dae46" containerName="util" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162619 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa39d73-ef69-4b84-b40c-7b51aa7dae46" containerName="util" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162624 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49de7306-7c31-4fa1-b9d3-3aec7a57f7d2" containerName="util" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162629 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="49de7306-7c31-4fa1-b9d3-3aec7a57f7d2" containerName="util" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162636 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a" containerName="util" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162641 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a" containerName="util" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162646 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa39d73-ef69-4b84-b40c-7b51aa7dae46" containerName="extract" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162650 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa39d73-ef69-4b84-b40c-7b51aa7dae46" containerName="extract" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162656 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae6e7c25-d0f2-4a43-83d8-367eac7928c4" containerName="extract" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162663 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae6e7c25-d0f2-4a43-83d8-367eac7928c4" containerName="extract" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162739 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c475865-8b38-43f7-8a04-7d131f351faa" containerName="console" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162751 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae6e7c25-d0f2-4a43-83d8-367eac7928c4" containerName="extract" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162763 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="efa39d73-ef69-4b84-b40c-7b51aa7dae46" containerName="extract" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162770 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="49de7306-7c31-4fa1-b9d3-3aec7a57f7d2" containerName="extract" Jul 08 12:10:22.162839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.162778 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a" containerName="extract" Jul 08 12:10:22.167363 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.167344 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dw4hb" Jul 08 12:10:22.169958 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.169936 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 12:10:22.170076 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.170016 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-sl458\"" Jul 08 12:10:22.171456 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.171433 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 12:10:22.174185 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.174164 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-dw4hb"] Jul 08 12:10:22.205102 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.205069 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:22.263465 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.263430 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fbtw\" (UniqueName: \"kubernetes.io/projected/69f4787f-f192-42a2-8a65-417cd80c711e-kube-api-access-7fbtw\") pod \"authorino-58cd955675-dw4hb\" (UID: \"69f4787f-f192-42a2-8a65-417cd80c711e\") " pod="kuadrant-system/authorino-58cd955675-dw4hb" Jul 08 12:10:22.308757 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.308721 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:22.364968 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.364903 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fbtw\" (UniqueName: \"kubernetes.io/projected/69f4787f-f192-42a2-8a65-417cd80c711e-kube-api-access-7fbtw\") pod \"authorino-58cd955675-dw4hb\" (UID: \"69f4787f-f192-42a2-8a65-417cd80c711e\") " pod="kuadrant-system/authorino-58cd955675-dw4hb" Jul 08 12:10:22.379522 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.379489 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fbtw\" (UniqueName: \"kubernetes.io/projected/69f4787f-f192-42a2-8a65-417cd80c711e-kube-api-access-7fbtw\") pod \"authorino-58cd955675-dw4hb\" (UID: \"69f4787f-f192-42a2-8a65-417cd80c711e\") " pod="kuadrant-system/authorino-58cd955675-dw4hb" Jul 08 12:10:22.477975 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.477864 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dw4hb" Jul 08 12:10:22.495869 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.495845 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-q46gt"] Jul 08 12:10:22.499429 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.499399 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-q46gt" Jul 08 12:10:22.511090 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.511067 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q46gt"] Jul 08 12:10:22.611699 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.611678 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-dw4hb"] Jul 08 12:10:22.613584 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:10:22.613559 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69f4787f_f192_42a2_8a65_417cd80c711e.slice/crio-cae1b2b140d1a285dd89912200cbb3d2608c2463e465602cbfb17af62cf3e366 WatchSource:0}: Error finding container cae1b2b140d1a285dd89912200cbb3d2608c2463e465602cbfb17af62cf3e366: Status 404 returned error can't find the container with id cae1b2b140d1a285dd89912200cbb3d2608c2463e465602cbfb17af62cf3e366 Jul 08 12:10:22.668094 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.668055 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fjrn\" (UniqueName: \"kubernetes.io/projected/27347671-a789-46be-a909-215b7110ca08-kube-api-access-7fjrn\") pod \"authorino-75d556bd77-q46gt\" (UID: \"27347671-a789-46be-a909-215b7110ca08\") " pod="kuadrant-system/authorino-75d556bd77-q46gt" Jul 08 12:10:22.768723 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.768690 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fjrn\" (UniqueName: \"kubernetes.io/projected/27347671-a789-46be-a909-215b7110ca08-kube-api-access-7fjrn\") pod \"authorino-75d556bd77-q46gt\" (UID: \"27347671-a789-46be-a909-215b7110ca08\") " pod="kuadrant-system/authorino-75d556bd77-q46gt" Jul 08 12:10:22.781265 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.781234 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fjrn\" (UniqueName: \"kubernetes.io/projected/27347671-a789-46be-a909-215b7110ca08-kube-api-access-7fjrn\") pod \"authorino-75d556bd77-q46gt\" (UID: \"27347671-a789-46be-a909-215b7110ca08\") " pod="kuadrant-system/authorino-75d556bd77-q46gt" Jul 08 12:10:22.809196 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.809171 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-q46gt" Jul 08 12:10:22.945874 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:22.945850 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q46gt"] Jul 08 12:10:22.947991 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:10:22.947966 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27347671_a789_46be_a909_215b7110ca08.slice/crio-beb323d0302c1fa2f612cab8b4c01fd6919dc253a387cbc557bd2d226f0d5eec WatchSource:0}: Error finding container beb323d0302c1fa2f612cab8b4c01fd6919dc253a387cbc557bd2d226f0d5eec: Status 404 returned error can't find the container with id beb323d0302c1fa2f612cab8b4c01fd6919dc253a387cbc557bd2d226f0d5eec Jul 08 12:10:23.490444 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:23.490376 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dw4hb" event={"ID":"69f4787f-f192-42a2-8a65-417cd80c711e","Type":"ContainerStarted","Data":"cae1b2b140d1a285dd89912200cbb3d2608c2463e465602cbfb17af62cf3e366"} Jul 08 12:10:23.492756 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:23.492704 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-q46gt" event={"ID":"27347671-a789-46be-a909-215b7110ca08","Type":"ContainerStarted","Data":"beb323d0302c1fa2f612cab8b4c01fd6919dc253a387cbc557bd2d226f0d5eec"} Jul 08 12:10:26.516583 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:26.516540 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dw4hb" event={"ID":"69f4787f-f192-42a2-8a65-417cd80c711e","Type":"ContainerStarted","Data":"850a83ff241abee051503fb1a99f1e33944e3d3d7874da0bdec57ced0c4631ac"} Jul 08 12:10:26.519112 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:26.519085 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-q46gt" event={"ID":"27347671-a789-46be-a909-215b7110ca08","Type":"ContainerStarted","Data":"4516c4c2470cb99f25837c22c21d24811cd56d81ab850a670c7d789f09b04b30"} Jul 08 12:10:26.534091 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:26.534037 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-dw4hb" podStartSLOduration=0.81586193 podStartE2EDuration="4.534016776s" totalImagesPullingTime="3.718154846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:10:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:10:26.532546224 +0000 UTC m=+537.892285530" watchObservedRunningTime="2026-07-08 12:10:26.534016776 +0000 UTC m=+537.893756087" Jul 08 12:10:26.548719 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:26.548666 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-q46gt" podStartSLOduration=1.152764059 podStartE2EDuration="4.54864982s" totalImagesPullingTime="3.395885761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:10:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:10:26.547082971 +0000 UTC m=+537.906822279" watchObservedRunningTime="2026-07-08 12:10:26.54864982 +0000 UTC m=+537.908389127" Jul 08 12:10:26.572079 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:26.572048 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-dw4hb"] Jul 08 12:10:28.528847 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:28.528809 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-dw4hb" podUID="69f4787f-f192-42a2-8a65-417cd80c711e" containerName="authorino" containerID="cri-o://850a83ff241abee051503fb1a99f1e33944e3d3d7874da0bdec57ced0c4631ac" gracePeriod=30 Jul 08 12:10:28.774759 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:28.774730 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dw4hb" Jul 08 12:10:28.925696 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:28.925602 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fbtw\" (UniqueName: \"kubernetes.io/projected/69f4787f-f192-42a2-8a65-417cd80c711e-kube-api-access-7fbtw\") pod \"69f4787f-f192-42a2-8a65-417cd80c711e\" (UID: \"69f4787f-f192-42a2-8a65-417cd80c711e\") " Jul 08 12:10:28.927689 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:28.927656 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69f4787f-f192-42a2-8a65-417cd80c711e-kube-api-access-7fbtw" (OuterVolumeSpecName: "kube-api-access-7fbtw") pod "69f4787f-f192-42a2-8a65-417cd80c711e" (UID: "69f4787f-f192-42a2-8a65-417cd80c711e"). InnerVolumeSpecName "kube-api-access-7fbtw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:10:29.026357 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:29.026317 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fbtw\" (UniqueName: \"kubernetes.io/projected/69f4787f-f192-42a2-8a65-417cd80c711e-kube-api-access-7fbtw\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:10:29.535619 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:29.535585 2560 generic.go:356] "Generic (PLEG): container finished" podID="69f4787f-f192-42a2-8a65-417cd80c711e" containerID="850a83ff241abee051503fb1a99f1e33944e3d3d7874da0bdec57ced0c4631ac" exitCode=0 Jul 08 12:10:29.536070 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:29.535635 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dw4hb" event={"ID":"69f4787f-f192-42a2-8a65-417cd80c711e","Type":"ContainerDied","Data":"850a83ff241abee051503fb1a99f1e33944e3d3d7874da0bdec57ced0c4631ac"} Jul 08 12:10:29.536070 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:29.535638 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dw4hb" Jul 08 12:10:29.536070 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:29.535665 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dw4hb" event={"ID":"69f4787f-f192-42a2-8a65-417cd80c711e","Type":"ContainerDied","Data":"cae1b2b140d1a285dd89912200cbb3d2608c2463e465602cbfb17af62cf3e366"} Jul 08 12:10:29.536070 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:29.535681 2560 scope.go:117] "RemoveContainer" containerID="850a83ff241abee051503fb1a99f1e33944e3d3d7874da0bdec57ced0c4631ac" Jul 08 12:10:29.544218 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:29.544199 2560 scope.go:117] "RemoveContainer" containerID="850a83ff241abee051503fb1a99f1e33944e3d3d7874da0bdec57ced0c4631ac" Jul 08 12:10:29.544476 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:10:29.544459 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"850a83ff241abee051503fb1a99f1e33944e3d3d7874da0bdec57ced0c4631ac\": container with ID starting with 850a83ff241abee051503fb1a99f1e33944e3d3d7874da0bdec57ced0c4631ac not found: ID does not exist" containerID="850a83ff241abee051503fb1a99f1e33944e3d3d7874da0bdec57ced0c4631ac" Jul 08 12:10:29.544517 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:29.544485 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"850a83ff241abee051503fb1a99f1e33944e3d3d7874da0bdec57ced0c4631ac"} err="failed to get container status \"850a83ff241abee051503fb1a99f1e33944e3d3d7874da0bdec57ced0c4631ac\": rpc error: code = NotFound desc = could not find container \"850a83ff241abee051503fb1a99f1e33944e3d3d7874da0bdec57ced0c4631ac\": container with ID starting with 850a83ff241abee051503fb1a99f1e33944e3d3d7874da0bdec57ced0c4631ac not found: ID does not exist" Jul 08 12:10:29.555002 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:29.554974 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-dw4hb"] Jul 08 12:10:29.561623 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:29.561603 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-dw4hb"] Jul 08 12:10:31.132509 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:31.132479 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69f4787f-f192-42a2-8a65-417cd80c711e" path="/var/lib/kubelet/pods/69f4787f-f192-42a2-8a65-417cd80c711e/volumes" Jul 08 12:10:42.338578 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:42.338543 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:42.437059 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:42.437028 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:42.866170 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:42.866138 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:55.348536 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.348498 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:55.560289 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.560255 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-44hjm"] Jul 08 12:10:55.560629 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.560617 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69f4787f-f192-42a2-8a65-417cd80c711e" containerName="authorino" Jul 08 12:10:55.560682 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.560631 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="69f4787f-f192-42a2-8a65-417cd80c711e" containerName="authorino" Jul 08 12:10:55.560724 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.560683 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="69f4787f-f192-42a2-8a65-417cd80c711e" containerName="authorino" Jul 08 12:10:55.563925 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.563894 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-44hjm" Jul 08 12:10:55.569323 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.569302 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-44hjm"] Jul 08 12:10:55.634599 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.634491 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:10:55.642299 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.642271 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhl98\" (UniqueName: \"kubernetes.io/projected/b7593893-42a6-4782-bfe7-afae245fcd7f-kube-api-access-lhl98\") pod \"authorino-5d4b67c446-44hjm\" (UID: \"b7593893-42a6-4782-bfe7-afae245fcd7f\") " pod="kuadrant-system/authorino-5d4b67c446-44hjm" Jul 08 12:10:55.743101 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.743060 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhl98\" (UniqueName: \"kubernetes.io/projected/b7593893-42a6-4782-bfe7-afae245fcd7f-kube-api-access-lhl98\") pod \"authorino-5d4b67c446-44hjm\" (UID: \"b7593893-42a6-4782-bfe7-afae245fcd7f\") " pod="kuadrant-system/authorino-5d4b67c446-44hjm" Jul 08 12:10:55.755116 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.755085 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhl98\" (UniqueName: \"kubernetes.io/projected/b7593893-42a6-4782-bfe7-afae245fcd7f-kube-api-access-lhl98\") pod \"authorino-5d4b67c446-44hjm\" (UID: \"b7593893-42a6-4782-bfe7-afae245fcd7f\") " pod="kuadrant-system/authorino-5d4b67c446-44hjm" Jul 08 12:10:55.795781 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.795743 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-44hjm"] Jul 08 12:10:55.796050 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.796037 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-44hjm" Jul 08 12:10:55.824052 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.824017 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-55bdf4b9b6-hp6z5"] Jul 08 12:10:55.828382 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.828354 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55bdf4b9b6-hp6z5" Jul 08 12:10:55.835515 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.835487 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55bdf4b9b6-hp6z5"] Jul 08 12:10:55.936853 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.936792 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-44hjm"] Jul 08 12:10:55.938724 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:10:55.938692 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7593893_42a6_4782_bfe7_afae245fcd7f.slice/crio-b9d2a108e9b88efc760d4ab775d5f2fcacda8ebdada09df8010008ec9b354e81 WatchSource:0}: Error finding container b9d2a108e9b88efc760d4ab775d5f2fcacda8ebdada09df8010008ec9b354e81: Status 404 returned error can't find the container with id b9d2a108e9b88efc760d4ab775d5f2fcacda8ebdada09df8010008ec9b354e81 Jul 08 12:10:55.939564 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.939531 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-55bdf4b9b6-hp6z5"] Jul 08 12:10:55.939838 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:10:55.939818 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-t4p2k], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-55bdf4b9b6-hp6z5" podUID="7dff945a-58ef-442b-a702-754cdd28af3a" Jul 08 12:10:55.944952 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.944901 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4p2k\" (UniqueName: \"kubernetes.io/projected/7dff945a-58ef-442b-a702-754cdd28af3a-kube-api-access-t4p2k\") pod \"authorino-55bdf4b9b6-hp6z5\" (UID: \"7dff945a-58ef-442b-a702-754cdd28af3a\") " pod="kuadrant-system/authorino-55bdf4b9b6-hp6z5" Jul 08 12:10:55.977592 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.977556 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84ccc879c8-wtttg"] Jul 08 12:10:55.981162 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.981138 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84ccc879c8-wtttg" Jul 08 12:10:55.983762 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.983743 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 08 12:10:55.990238 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:55.990217 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84ccc879c8-wtttg"] Jul 08 12:10:56.045597 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.045557 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4p2k\" (UniqueName: \"kubernetes.io/projected/7dff945a-58ef-442b-a702-754cdd28af3a-kube-api-access-t4p2k\") pod \"authorino-55bdf4b9b6-hp6z5\" (UID: \"7dff945a-58ef-442b-a702-754cdd28af3a\") " pod="kuadrant-system/authorino-55bdf4b9b6-hp6z5" Jul 08 12:10:56.045781 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.045604 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f5058dc3-6dac-4986-b78f-a1238091d030-tls-cert\") pod \"authorino-84ccc879c8-wtttg\" (UID: \"f5058dc3-6dac-4986-b78f-a1238091d030\") " pod="kuadrant-system/authorino-84ccc879c8-wtttg" Jul 08 12:10:56.045781 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.045649 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9tl2\" (UniqueName: \"kubernetes.io/projected/f5058dc3-6dac-4986-b78f-a1238091d030-kube-api-access-c9tl2\") pod \"authorino-84ccc879c8-wtttg\" (UID: \"f5058dc3-6dac-4986-b78f-a1238091d030\") " pod="kuadrant-system/authorino-84ccc879c8-wtttg" Jul 08 12:10:56.056629 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.056595 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4p2k\" (UniqueName: \"kubernetes.io/projected/7dff945a-58ef-442b-a702-754cdd28af3a-kube-api-access-t4p2k\") pod \"authorino-55bdf4b9b6-hp6z5\" (UID: \"7dff945a-58ef-442b-a702-754cdd28af3a\") " pod="kuadrant-system/authorino-55bdf4b9b6-hp6z5" Jul 08 12:10:56.146589 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.146500 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f5058dc3-6dac-4986-b78f-a1238091d030-tls-cert\") pod \"authorino-84ccc879c8-wtttg\" (UID: \"f5058dc3-6dac-4986-b78f-a1238091d030\") " pod="kuadrant-system/authorino-84ccc879c8-wtttg" Jul 08 12:10:56.146589 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.146547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9tl2\" (UniqueName: \"kubernetes.io/projected/f5058dc3-6dac-4986-b78f-a1238091d030-kube-api-access-c9tl2\") pod \"authorino-84ccc879c8-wtttg\" (UID: \"f5058dc3-6dac-4986-b78f-a1238091d030\") " pod="kuadrant-system/authorino-84ccc879c8-wtttg" Jul 08 12:10:56.148871 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.148848 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f5058dc3-6dac-4986-b78f-a1238091d030-tls-cert\") pod \"authorino-84ccc879c8-wtttg\" (UID: \"f5058dc3-6dac-4986-b78f-a1238091d030\") " pod="kuadrant-system/authorino-84ccc879c8-wtttg" Jul 08 12:10:56.164410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.164383 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9tl2\" (UniqueName: \"kubernetes.io/projected/f5058dc3-6dac-4986-b78f-a1238091d030-kube-api-access-c9tl2\") pod \"authorino-84ccc879c8-wtttg\" (UID: \"f5058dc3-6dac-4986-b78f-a1238091d030\") " pod="kuadrant-system/authorino-84ccc879c8-wtttg" Jul 08 12:10:56.291424 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.291378 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84ccc879c8-wtttg" Jul 08 12:10:56.444446 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.444416 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84ccc879c8-wtttg"] Jul 08 12:10:56.446571 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:10:56.446534 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5058dc3_6dac_4986_b78f_a1238091d030.slice/crio-7fdf2ccc567ece57987c472b3abb3432bff9d43d4d0eed9fa87340b4f22909f5 WatchSource:0}: Error finding container 7fdf2ccc567ece57987c472b3abb3432bff9d43d4d0eed9fa87340b4f22909f5: Status 404 returned error can't find the container with id 7fdf2ccc567ece57987c472b3abb3432bff9d43d4d0eed9fa87340b4f22909f5 Jul 08 12:10:56.674550 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.674493 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-44hjm" event={"ID":"b7593893-42a6-4782-bfe7-afae245fcd7f","Type":"ContainerStarted","Data":"c9bbc04695349158c980c0cc5fac79ce664275b629170fafa438b90b24f232ff"} Jul 08 12:10:56.674766 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.674538 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-44hjm" podUID="b7593893-42a6-4782-bfe7-afae245fcd7f" containerName="authorino" containerID="cri-o://c9bbc04695349158c980c0cc5fac79ce664275b629170fafa438b90b24f232ff" gracePeriod=30 Jul 08 12:10:56.674766 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.674565 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-44hjm" event={"ID":"b7593893-42a6-4782-bfe7-afae245fcd7f","Type":"ContainerStarted","Data":"b9d2a108e9b88efc760d4ab775d5f2fcacda8ebdada09df8010008ec9b354e81"} Jul 08 12:10:56.675760 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.675729 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84ccc879c8-wtttg" event={"ID":"f5058dc3-6dac-4986-b78f-a1238091d030","Type":"ContainerStarted","Data":"7fdf2ccc567ece57987c472b3abb3432bff9d43d4d0eed9fa87340b4f22909f5"} Jul 08 12:10:56.675876 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.675807 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55bdf4b9b6-hp6z5" Jul 08 12:10:56.683040 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.683019 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55bdf4b9b6-hp6z5" Jul 08 12:10:56.694779 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.694691 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-44hjm" podStartSLOduration=1.338736911 podStartE2EDuration="1.694674023s" totalImagesPullingTime="355.937112ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:10:56.693533895 +0000 UTC m=+568.053273203" watchObservedRunningTime="2026-07-08 12:10:56.694674023 +0000 UTC m=+568.054413329" Jul 08 12:10:56.752735 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.752700 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4p2k\" (UniqueName: \"kubernetes.io/projected/7dff945a-58ef-442b-a702-754cdd28af3a-kube-api-access-t4p2k\") pod \"7dff945a-58ef-442b-a702-754cdd28af3a\" (UID: \"7dff945a-58ef-442b-a702-754cdd28af3a\") " Jul 08 12:10:56.754758 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.754735 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dff945a-58ef-442b-a702-754cdd28af3a-kube-api-access-t4p2k" (OuterVolumeSpecName: "kube-api-access-t4p2k") pod "7dff945a-58ef-442b-a702-754cdd28af3a" (UID: "7dff945a-58ef-442b-a702-754cdd28af3a"). InnerVolumeSpecName "kube-api-access-t4p2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:10:56.853668 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.853640 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4p2k\" (UniqueName: \"kubernetes.io/projected/7dff945a-58ef-442b-a702-754cdd28af3a-kube-api-access-t4p2k\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:10:56.924241 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.924218 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-44hjm" Jul 08 12:10:56.954224 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.954128 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhl98\" (UniqueName: \"kubernetes.io/projected/b7593893-42a6-4782-bfe7-afae245fcd7f-kube-api-access-lhl98\") pod \"b7593893-42a6-4782-bfe7-afae245fcd7f\" (UID: \"b7593893-42a6-4782-bfe7-afae245fcd7f\") " Jul 08 12:10:56.956424 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:56.956392 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7593893-42a6-4782-bfe7-afae245fcd7f-kube-api-access-lhl98" (OuterVolumeSpecName: "kube-api-access-lhl98") pod "b7593893-42a6-4782-bfe7-afae245fcd7f" (UID: "b7593893-42a6-4782-bfe7-afae245fcd7f"). InnerVolumeSpecName "kube-api-access-lhl98". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:10:57.055119 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:57.055084 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhl98\" (UniqueName: \"kubernetes.io/projected/b7593893-42a6-4782-bfe7-afae245fcd7f-kube-api-access-lhl98\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:10:57.682812 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:57.682781 2560 generic.go:356] "Generic (PLEG): container finished" podID="b7593893-42a6-4782-bfe7-afae245fcd7f" containerID="c9bbc04695349158c980c0cc5fac79ce664275b629170fafa438b90b24f232ff" exitCode=0 Jul 08 12:10:57.683307 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:57.682828 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-44hjm" Jul 08 12:10:57.683307 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:57.682864 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-44hjm" event={"ID":"b7593893-42a6-4782-bfe7-afae245fcd7f","Type":"ContainerDied","Data":"c9bbc04695349158c980c0cc5fac79ce664275b629170fafa438b90b24f232ff"} Jul 08 12:10:57.683307 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:57.682935 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-44hjm" event={"ID":"b7593893-42a6-4782-bfe7-afae245fcd7f","Type":"ContainerDied","Data":"b9d2a108e9b88efc760d4ab775d5f2fcacda8ebdada09df8010008ec9b354e81"} Jul 08 12:10:57.683307 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:57.682963 2560 scope.go:117] "RemoveContainer" containerID="c9bbc04695349158c980c0cc5fac79ce664275b629170fafa438b90b24f232ff" Jul 08 12:10:57.684535 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:57.684512 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84ccc879c8-wtttg" event={"ID":"f5058dc3-6dac-4986-b78f-a1238091d030","Type":"ContainerStarted","Data":"da2ca723d23fe6616e0ebcba190b35935518ca4e50c56b580f3f18a252fdc67a"} Jul 08 12:10:57.684664 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:57.684551 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55bdf4b9b6-hp6z5" Jul 08 12:10:57.692024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:57.692008 2560 scope.go:117] "RemoveContainer" containerID="c9bbc04695349158c980c0cc5fac79ce664275b629170fafa438b90b24f232ff" Jul 08 12:10:57.692269 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:10:57.692250 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9bbc04695349158c980c0cc5fac79ce664275b629170fafa438b90b24f232ff\": container with ID starting with c9bbc04695349158c980c0cc5fac79ce664275b629170fafa438b90b24f232ff not found: ID does not exist" containerID="c9bbc04695349158c980c0cc5fac79ce664275b629170fafa438b90b24f232ff" Jul 08 12:10:57.692323 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:57.692280 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9bbc04695349158c980c0cc5fac79ce664275b629170fafa438b90b24f232ff"} err="failed to get container status \"c9bbc04695349158c980c0cc5fac79ce664275b629170fafa438b90b24f232ff\": rpc error: code = NotFound desc = could not find container \"c9bbc04695349158c980c0cc5fac79ce664275b629170fafa438b90b24f232ff\": container with ID starting with c9bbc04695349158c980c0cc5fac79ce664275b629170fafa438b90b24f232ff not found: ID does not exist" Jul 08 12:10:57.705570 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:57.705527 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-84ccc879c8-wtttg" podStartSLOduration=2.309880558 podStartE2EDuration="2.705511612s" totalImagesPullingTime="395.631054ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:10:57.704086066 +0000 UTC m=+569.063825374" watchObservedRunningTime="2026-07-08 12:10:57.705511612 +0000 UTC m=+569.065250919" Jul 08 12:10:57.733653 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:57.733623 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q46gt"] Jul 08 12:10:57.733853 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:57.733803 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-q46gt" podUID="27347671-a789-46be-a909-215b7110ca08" containerName="authorino" containerID="cri-o://4516c4c2470cb99f25837c22c21d24811cd56d81ab850a670c7d789f09b04b30" gracePeriod=30 Jul 08 12:10:57.738824 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:57.738800 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-55bdf4b9b6-hp6z5"] Jul 08 12:10:57.751646 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:57.751612 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-55bdf4b9b6-hp6z5"] Jul 08 12:10:57.773962 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:57.773931 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-44hjm"] Jul 08 12:10:57.781040 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:57.781014 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-44hjm"] Jul 08 12:10:58.013781 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:58.013752 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-q46gt" Jul 08 12:10:58.065439 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:58.065410 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fjrn\" (UniqueName: \"kubernetes.io/projected/27347671-a789-46be-a909-215b7110ca08-kube-api-access-7fjrn\") pod \"27347671-a789-46be-a909-215b7110ca08\" (UID: \"27347671-a789-46be-a909-215b7110ca08\") " Jul 08 12:10:58.067459 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:58.067436 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27347671-a789-46be-a909-215b7110ca08-kube-api-access-7fjrn" (OuterVolumeSpecName: "kube-api-access-7fjrn") pod "27347671-a789-46be-a909-215b7110ca08" (UID: "27347671-a789-46be-a909-215b7110ca08"). InnerVolumeSpecName "kube-api-access-7fjrn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:10:58.166402 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:58.166363 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fjrn\" (UniqueName: \"kubernetes.io/projected/27347671-a789-46be-a909-215b7110ca08-kube-api-access-7fjrn\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:10:58.691494 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:58.691466 2560 generic.go:356] "Generic (PLEG): container finished" podID="27347671-a789-46be-a909-215b7110ca08" containerID="4516c4c2470cb99f25837c22c21d24811cd56d81ab850a670c7d789f09b04b30" exitCode=0 Jul 08 12:10:58.691990 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:58.691508 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-q46gt" Jul 08 12:10:58.691990 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:58.691547 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-q46gt" event={"ID":"27347671-a789-46be-a909-215b7110ca08","Type":"ContainerDied","Data":"4516c4c2470cb99f25837c22c21d24811cd56d81ab850a670c7d789f09b04b30"} Jul 08 12:10:58.691990 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:58.691580 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-q46gt" event={"ID":"27347671-a789-46be-a909-215b7110ca08","Type":"ContainerDied","Data":"beb323d0302c1fa2f612cab8b4c01fd6919dc253a387cbc557bd2d226f0d5eec"} Jul 08 12:10:58.691990 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:58.691603 2560 scope.go:117] "RemoveContainer" containerID="4516c4c2470cb99f25837c22c21d24811cd56d81ab850a670c7d789f09b04b30" Jul 08 12:10:58.700869 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:58.700852 2560 scope.go:117] "RemoveContainer" containerID="4516c4c2470cb99f25837c22c21d24811cd56d81ab850a670c7d789f09b04b30" Jul 08 12:10:58.701173 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:10:58.701151 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4516c4c2470cb99f25837c22c21d24811cd56d81ab850a670c7d789f09b04b30\": container with ID starting with 4516c4c2470cb99f25837c22c21d24811cd56d81ab850a670c7d789f09b04b30 not found: ID does not exist" containerID="4516c4c2470cb99f25837c22c21d24811cd56d81ab850a670c7d789f09b04b30" Jul 08 12:10:58.701236 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:58.701181 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4516c4c2470cb99f25837c22c21d24811cd56d81ab850a670c7d789f09b04b30"} err="failed to get container status \"4516c4c2470cb99f25837c22c21d24811cd56d81ab850a670c7d789f09b04b30\": rpc error: code = NotFound desc = could not find container \"4516c4c2470cb99f25837c22c21d24811cd56d81ab850a670c7d789f09b04b30\": container with ID starting with 4516c4c2470cb99f25837c22c21d24811cd56d81ab850a670c7d789f09b04b30 not found: ID does not exist" Jul 08 12:10:58.717679 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:58.717647 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q46gt"] Jul 08 12:10:58.721816 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:58.721792 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q46gt"] Jul 08 12:10:59.133156 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:59.133124 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27347671-a789-46be-a909-215b7110ca08" path="/var/lib/kubelet/pods/27347671-a789-46be-a909-215b7110ca08/volumes" Jul 08 12:10:59.133458 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:59.133446 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dff945a-58ef-442b-a702-754cdd28af3a" path="/var/lib/kubelet/pods/7dff945a-58ef-442b-a702-754cdd28af3a/volumes" Jul 08 12:10:59.133635 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:10:59.133624 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7593893-42a6-4782-bfe7-afae245fcd7f" path="/var/lib/kubelet/pods/b7593893-42a6-4782-bfe7-afae245fcd7f/volumes" Jul 08 12:11:02.165077 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:11:02.165047 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:11:02.272229 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:11:02.272191 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:11:02.372397 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:11:02.372355 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:11:02.436115 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:11:02.436031 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:11:05.539689 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:11:05.539632 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:11:05.641124 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:11:05.641084 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:11:13.912162 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:11:13.912107 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:11:29.144024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:11:29.143993 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:11:29.144460 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:11:29.144269 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:11:37.089646 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:11:37.089577 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:11:37.574559 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:11:37.574523 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:11:37.893012 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:11:37.892862 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:11:38.074361 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:11:38.074300 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:11:38.178326 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:11:38.178223 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:11:48.350874 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:11:48.350800 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:11:48.465713 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:11:48.465679 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:11:56.429372 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:11:56.429287 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:12:08.355408 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:08.355366 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:12:23.717306 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.717273 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7"] Jul 08 12:12:23.717708 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.717620 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27347671-a789-46be-a909-215b7110ca08" containerName="authorino" Jul 08 12:12:23.717708 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.717630 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="27347671-a789-46be-a909-215b7110ca08" containerName="authorino" Jul 08 12:12:23.717708 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.717648 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7593893-42a6-4782-bfe7-afae245fcd7f" containerName="authorino" Jul 08 12:12:23.717708 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.717653 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7593893-42a6-4782-bfe7-afae245fcd7f" containerName="authorino" Jul 08 12:12:23.717844 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.717712 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7593893-42a6-4782-bfe7-afae245fcd7f" containerName="authorino" Jul 08 12:12:23.717844 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.717722 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="27347671-a789-46be-a909-215b7110ca08" containerName="authorino" Jul 08 12:12:23.720642 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.720625 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:23.721879 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.721857 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81e694c1-22a5-4ac2-9f7c-c87d46aabd09-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kjfx7\" (UID: \"81e694c1-22a5-4ac2-9f7c-c87d46aabd09\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:23.722013 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.721893 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81e694c1-22a5-4ac2-9f7c-c87d46aabd09-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kjfx7\" (UID: \"81e694c1-22a5-4ac2-9f7c-c87d46aabd09\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:23.722013 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.721998 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81e694c1-22a5-4ac2-9f7c-c87d46aabd09-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kjfx7\" (UID: \"81e694c1-22a5-4ac2-9f7c-c87d46aabd09\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:23.722095 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.722028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6phz\" (UniqueName: \"kubernetes.io/projected/81e694c1-22a5-4ac2-9f7c-c87d46aabd09-kube-api-access-s6phz\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kjfx7\" (UID: \"81e694c1-22a5-4ac2-9f7c-c87d46aabd09\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:23.722095 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.722060 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81e694c1-22a5-4ac2-9f7c-c87d46aabd09-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kjfx7\" (UID: \"81e694c1-22a5-4ac2-9f7c-c87d46aabd09\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:23.722095 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.722082 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81e694c1-22a5-4ac2-9f7c-c87d46aabd09-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kjfx7\" (UID: \"81e694c1-22a5-4ac2-9f7c-c87d46aabd09\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:23.726067 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.726040 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 12:12:23.726338 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.726084 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 12:12:23.727280 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.727261 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 08 12:12:23.727402 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.727267 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f4pdd\"" Jul 08 12:12:23.738368 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.738343 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7"] Jul 08 12:12:23.822927 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.822890 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81e694c1-22a5-4ac2-9f7c-c87d46aabd09-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kjfx7\" (UID: \"81e694c1-22a5-4ac2-9f7c-c87d46aabd09\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:23.823092 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.822975 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81e694c1-22a5-4ac2-9f7c-c87d46aabd09-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kjfx7\" (UID: \"81e694c1-22a5-4ac2-9f7c-c87d46aabd09\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:23.823092 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.823038 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81e694c1-22a5-4ac2-9f7c-c87d46aabd09-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kjfx7\" (UID: \"81e694c1-22a5-4ac2-9f7c-c87d46aabd09\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:23.823092 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.823066 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6phz\" (UniqueName: \"kubernetes.io/projected/81e694c1-22a5-4ac2-9f7c-c87d46aabd09-kube-api-access-s6phz\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kjfx7\" (UID: \"81e694c1-22a5-4ac2-9f7c-c87d46aabd09\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:23.823262 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.823110 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81e694c1-22a5-4ac2-9f7c-c87d46aabd09-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kjfx7\" (UID: \"81e694c1-22a5-4ac2-9f7c-c87d46aabd09\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:23.823262 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.823133 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81e694c1-22a5-4ac2-9f7c-c87d46aabd09-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kjfx7\" (UID: \"81e694c1-22a5-4ac2-9f7c-c87d46aabd09\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:23.823443 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.823419 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81e694c1-22a5-4ac2-9f7c-c87d46aabd09-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kjfx7\" (UID: \"81e694c1-22a5-4ac2-9f7c-c87d46aabd09\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:23.823443 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.823433 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81e694c1-22a5-4ac2-9f7c-c87d46aabd09-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kjfx7\" (UID: \"81e694c1-22a5-4ac2-9f7c-c87d46aabd09\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:23.823559 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.823501 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81e694c1-22a5-4ac2-9f7c-c87d46aabd09-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kjfx7\" (UID: \"81e694c1-22a5-4ac2-9f7c-c87d46aabd09\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:23.825238 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.825217 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81e694c1-22a5-4ac2-9f7c-c87d46aabd09-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kjfx7\" (UID: \"81e694c1-22a5-4ac2-9f7c-c87d46aabd09\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:23.825513 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.825497 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81e694c1-22a5-4ac2-9f7c-c87d46aabd09-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kjfx7\" (UID: \"81e694c1-22a5-4ac2-9f7c-c87d46aabd09\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:23.829601 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.829574 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:12:23.833175 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:23.833158 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6phz\" (UniqueName: \"kubernetes.io/projected/81e694c1-22a5-4ac2-9f7c-c87d46aabd09-kube-api-access-s6phz\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kjfx7\" (UID: \"81e694c1-22a5-4ac2-9f7c-c87d46aabd09\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:24.031346 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:24.031319 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:24.179492 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:12:24.179461 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e694c1_22a5_4ac2_9f7c_c87d46aabd09.slice/crio-38393dd33fed5d418d14f2b4f5d8f6c836b64af43dc1c9084a6562f14f778dc2 WatchSource:0}: Error finding container 38393dd33fed5d418d14f2b4f5d8f6c836b64af43dc1c9084a6562f14f778dc2: Status 404 returned error can't find the container with id 38393dd33fed5d418d14f2b4f5d8f6c836b64af43dc1c9084a6562f14f778dc2 Jul 08 12:12:24.180843 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:24.180821 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 12:12:24.181503 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:24.181390 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7"] Jul 08 12:12:25.143969 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:25.143925 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" event={"ID":"81e694c1-22a5-4ac2-9f7c-c87d46aabd09","Type":"ContainerStarted","Data":"38393dd33fed5d418d14f2b4f5d8f6c836b64af43dc1c9084a6562f14f778dc2"} Jul 08 12:12:26.145370 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:26.145333 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" event={"ID":"81e694c1-22a5-4ac2-9f7c-c87d46aabd09","Type":"ContainerStarted","Data":"ea5e727589236d4092e52b423cd80ebcdc913d0fc479b0bea913e203f2d94283"} Jul 08 12:12:26.169923 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:26.169852 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" podStartSLOduration=2.006458292 podStartE2EDuration="3.169836765s" totalImagesPullingTime="1.163378473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:12:26.169774668 +0000 UTC m=+657.529513976" watchObservedRunningTime="2026-07-08 12:12:26.169836765 +0000 UTC m=+657.529576082" Jul 08 12:12:26.349108 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:26.349069 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:12:26.458201 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:26.458111 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:12:34.032155 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:34.032124 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:34.032561 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:34.032184 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:34.044528 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:34.044500 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:34.195189 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:34.195163 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kjfx7" Jul 08 12:12:35.870610 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:35.870576 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:12:46.328383 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:12:46.328335 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:13:09.639052 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.639010 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz"] Jul 08 12:13:09.645347 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.645326 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.648269 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.648249 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 08 12:13:09.655148 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.655121 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz"] Jul 08 12:13:09.728617 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.728582 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:13:09.829539 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.829507 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2dfbc88-6829-43ef-bf92-e47d821cbfb3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz\" (UID: \"e2dfbc88-6829-43ef-bf92-e47d821cbfb3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.829733 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.829550 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2dfbc88-6829-43ef-bf92-e47d821cbfb3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz\" (UID: \"e2dfbc88-6829-43ef-bf92-e47d821cbfb3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.829733 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.829580 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2dfbc88-6829-43ef-bf92-e47d821cbfb3-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz\" (UID: \"e2dfbc88-6829-43ef-bf92-e47d821cbfb3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.829733 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.829629 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2dfbc88-6829-43ef-bf92-e47d821cbfb3-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz\" (UID: \"e2dfbc88-6829-43ef-bf92-e47d821cbfb3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.829733 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.829664 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7kh7\" (UniqueName: \"kubernetes.io/projected/e2dfbc88-6829-43ef-bf92-e47d821cbfb3-kube-api-access-s7kh7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz\" (UID: \"e2dfbc88-6829-43ef-bf92-e47d821cbfb3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.829733 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.829693 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2dfbc88-6829-43ef-bf92-e47d821cbfb3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz\" (UID: \"e2dfbc88-6829-43ef-bf92-e47d821cbfb3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.931009 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.930884 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7kh7\" (UniqueName: \"kubernetes.io/projected/e2dfbc88-6829-43ef-bf92-e47d821cbfb3-kube-api-access-s7kh7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz\" (UID: \"e2dfbc88-6829-43ef-bf92-e47d821cbfb3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.931009 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.930971 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2dfbc88-6829-43ef-bf92-e47d821cbfb3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz\" (UID: \"e2dfbc88-6829-43ef-bf92-e47d821cbfb3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.931009 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.930993 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2dfbc88-6829-43ef-bf92-e47d821cbfb3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz\" (UID: \"e2dfbc88-6829-43ef-bf92-e47d821cbfb3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.931284 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.931014 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2dfbc88-6829-43ef-bf92-e47d821cbfb3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz\" (UID: \"e2dfbc88-6829-43ef-bf92-e47d821cbfb3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.931284 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.931048 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2dfbc88-6829-43ef-bf92-e47d821cbfb3-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz\" (UID: \"e2dfbc88-6829-43ef-bf92-e47d821cbfb3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.931284 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.931109 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2dfbc88-6829-43ef-bf92-e47d821cbfb3-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz\" (UID: \"e2dfbc88-6829-43ef-bf92-e47d821cbfb3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.931417 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.931401 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2dfbc88-6829-43ef-bf92-e47d821cbfb3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz\" (UID: \"e2dfbc88-6829-43ef-bf92-e47d821cbfb3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.931489 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.931459 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2dfbc88-6829-43ef-bf92-e47d821cbfb3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz\" (UID: \"e2dfbc88-6829-43ef-bf92-e47d821cbfb3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.931489 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.931489 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2dfbc88-6829-43ef-bf92-e47d821cbfb3-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz\" (UID: \"e2dfbc88-6829-43ef-bf92-e47d821cbfb3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.933253 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.933236 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2dfbc88-6829-43ef-bf92-e47d821cbfb3-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz\" (UID: \"e2dfbc88-6829-43ef-bf92-e47d821cbfb3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.933538 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.933517 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2dfbc88-6829-43ef-bf92-e47d821cbfb3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz\" (UID: \"e2dfbc88-6829-43ef-bf92-e47d821cbfb3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.944527 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.944496 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7kh7\" (UniqueName: \"kubernetes.io/projected/e2dfbc88-6829-43ef-bf92-e47d821cbfb3-kube-api-access-s7kh7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz\" (UID: \"e2dfbc88-6829-43ef-bf92-e47d821cbfb3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:09.955180 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:09.955148 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:10.101690 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:10.101665 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz"] Jul 08 12:13:10.103688 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:13:10.103666 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2dfbc88_6829_43ef_bf92_e47d821cbfb3.slice/crio-bfd1bc5dab3842a8a08a2bc7de2351eccb6ca853490660f55377304f30b4e3e6 WatchSource:0}: Error finding container bfd1bc5dab3842a8a08a2bc7de2351eccb6ca853490660f55377304f30b4e3e6: Status 404 returned error can't find the container with id bfd1bc5dab3842a8a08a2bc7de2351eccb6ca853490660f55377304f30b4e3e6 Jul 08 12:13:10.370142 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:10.370114 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" event={"ID":"e2dfbc88-6829-43ef-bf92-e47d821cbfb3","Type":"ContainerStarted","Data":"bfd1bc5dab3842a8a08a2bc7de2351eccb6ca853490660f55377304f30b4e3e6"} Jul 08 12:13:11.376587 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:11.376543 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" event={"ID":"e2dfbc88-6829-43ef-bf92-e47d821cbfb3","Type":"ContainerStarted","Data":"d4c87772ac4f97df659cba5465b90002f77d7dec0d5a9ea1f6326bc064a0ec40"} Jul 08 12:13:11.402686 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:11.402634 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" podStartSLOduration=2.189874832 podStartE2EDuration="2.402619883s" totalImagesPullingTime="212.745051ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:13:11.399983858 +0000 UTC m=+702.759723167" watchObservedRunningTime="2026-07-08 12:13:11.402619883 +0000 UTC m=+702.762359189" Jul 08 12:13:19.955804 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:19.955761 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:19.955804 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:19.955809 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:19.968191 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:19.968162 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:20.450357 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:20.450331 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz" Jul 08 12:13:23.522973 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:23.522878 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:13:52.577494 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:13:52.577455 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:14:07.337282 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:07.337247 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:14:50.012500 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:50.012461 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6dbfc7956c-hzhch"] Jul 08 12:14:50.015849 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:50.015829 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dbfc7956c-hzhch" Jul 08 12:14:50.032709 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:50.032676 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dbfc7956c-hzhch"] Jul 08 12:14:50.107818 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:50.107785 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/27b7c4f8-c08d-44b8-9c65-45a7dd11762e-tls-cert\") pod \"authorino-6dbfc7956c-hzhch\" (UID: \"27b7c4f8-c08d-44b8-9c65-45a7dd11762e\") " pod="kuadrant-system/authorino-6dbfc7956c-hzhch" Jul 08 12:14:50.108034 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:50.107859 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf67f\" (UniqueName: \"kubernetes.io/projected/27b7c4f8-c08d-44b8-9c65-45a7dd11762e-kube-api-access-xf67f\") pod \"authorino-6dbfc7956c-hzhch\" (UID: \"27b7c4f8-c08d-44b8-9c65-45a7dd11762e\") " pod="kuadrant-system/authorino-6dbfc7956c-hzhch" Jul 08 12:14:50.208741 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:50.208701 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/27b7c4f8-c08d-44b8-9c65-45a7dd11762e-tls-cert\") pod \"authorino-6dbfc7956c-hzhch\" (UID: \"27b7c4f8-c08d-44b8-9c65-45a7dd11762e\") " pod="kuadrant-system/authorino-6dbfc7956c-hzhch" Jul 08 12:14:50.208991 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:50.208790 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf67f\" (UniqueName: \"kubernetes.io/projected/27b7c4f8-c08d-44b8-9c65-45a7dd11762e-kube-api-access-xf67f\") pod \"authorino-6dbfc7956c-hzhch\" (UID: \"27b7c4f8-c08d-44b8-9c65-45a7dd11762e\") " pod="kuadrant-system/authorino-6dbfc7956c-hzhch" Jul 08 12:14:50.211416 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:50.211392 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/27b7c4f8-c08d-44b8-9c65-45a7dd11762e-tls-cert\") pod \"authorino-6dbfc7956c-hzhch\" (UID: \"27b7c4f8-c08d-44b8-9c65-45a7dd11762e\") " pod="kuadrant-system/authorino-6dbfc7956c-hzhch" Jul 08 12:14:50.212008 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:50.211984 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:14:50.220872 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:50.220849 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf67f\" (UniqueName: \"kubernetes.io/projected/27b7c4f8-c08d-44b8-9c65-45a7dd11762e-kube-api-access-xf67f\") pod \"authorino-6dbfc7956c-hzhch\" (UID: \"27b7c4f8-c08d-44b8-9c65-45a7dd11762e\") " pod="kuadrant-system/authorino-6dbfc7956c-hzhch" Jul 08 12:14:50.314535 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:50.314437 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:14:50.325272 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:50.325246 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dbfc7956c-hzhch" Jul 08 12:14:50.473725 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:50.473692 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dbfc7956c-hzhch"] Jul 08 12:14:50.477054 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:14:50.477028 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27b7c4f8_c08d_44b8_9c65_45a7dd11762e.slice/crio-3fede963e4b756d6e90ee85011a5a2daa219ef96efa4d9de9e51b9c8633a66eb WatchSource:0}: Error finding container 3fede963e4b756d6e90ee85011a5a2daa219ef96efa4d9de9e51b9c8633a66eb: Status 404 returned error can't find the container with id 3fede963e4b756d6e90ee85011a5a2daa219ef96efa4d9de9e51b9c8633a66eb Jul 08 12:14:50.925274 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:50.925237 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dbfc7956c-hzhch" event={"ID":"27b7c4f8-c08d-44b8-9c65-45a7dd11762e","Type":"ContainerStarted","Data":"3fede963e4b756d6e90ee85011a5a2daa219ef96efa4d9de9e51b9c8633a66eb"} Jul 08 12:14:51.386616 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:51.386514 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:14:51.506185 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:51.506146 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:14:51.933512 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:51.933471 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dbfc7956c-hzhch" event={"ID":"27b7c4f8-c08d-44b8-9c65-45a7dd11762e","Type":"ContainerStarted","Data":"880f78126c6ec7fff9c848f797bd22f8c52b3a3222accc268eca28a773e75aa7"} Jul 08 12:14:51.972365 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:51.972309 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6dbfc7956c-hzhch" podStartSLOduration=2.450999797 podStartE2EDuration="2.972293543s" totalImagesPullingTime="521.293746ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:14:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:14:51.971970402 +0000 UTC m=+803.331709712" watchObservedRunningTime="2026-07-08 12:14:51.972293543 +0000 UTC m=+803.332032850" Jul 08 12:14:52.042103 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:52.042069 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84ccc879c8-wtttg"] Jul 08 12:14:52.042300 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:52.042274 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-84ccc879c8-wtttg" podUID="f5058dc3-6dac-4986-b78f-a1238091d030" containerName="authorino" containerID="cri-o://da2ca723d23fe6616e0ebcba190b35935518ca4e50c56b580f3f18a252fdc67a" gracePeriod=30 Jul 08 12:14:52.307508 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:52.307481 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84ccc879c8-wtttg" Jul 08 12:14:52.427789 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:52.427755 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9tl2\" (UniqueName: \"kubernetes.io/projected/f5058dc3-6dac-4986-b78f-a1238091d030-kube-api-access-c9tl2\") pod \"f5058dc3-6dac-4986-b78f-a1238091d030\" (UID: \"f5058dc3-6dac-4986-b78f-a1238091d030\") " Jul 08 12:14:52.428266 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:52.427851 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f5058dc3-6dac-4986-b78f-a1238091d030-tls-cert\") pod \"f5058dc3-6dac-4986-b78f-a1238091d030\" (UID: \"f5058dc3-6dac-4986-b78f-a1238091d030\") " Jul 08 12:14:52.430038 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:52.430007 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5058dc3-6dac-4986-b78f-a1238091d030-kube-api-access-c9tl2" (OuterVolumeSpecName: "kube-api-access-c9tl2") pod "f5058dc3-6dac-4986-b78f-a1238091d030" (UID: "f5058dc3-6dac-4986-b78f-a1238091d030"). InnerVolumeSpecName "kube-api-access-c9tl2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:14:52.438546 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:52.438518 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5058dc3-6dac-4986-b78f-a1238091d030-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f5058dc3-6dac-4986-b78f-a1238091d030" (UID: "f5058dc3-6dac-4986-b78f-a1238091d030"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 12:14:52.529203 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:52.529166 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9tl2\" (UniqueName: \"kubernetes.io/projected/f5058dc3-6dac-4986-b78f-a1238091d030-kube-api-access-c9tl2\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:14:52.529203 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:52.529197 2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f5058dc3-6dac-4986-b78f-a1238091d030-tls-cert\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:14:52.940433 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:52.940342 2560 generic.go:356] "Generic (PLEG): container finished" podID="f5058dc3-6dac-4986-b78f-a1238091d030" containerID="da2ca723d23fe6616e0ebcba190b35935518ca4e50c56b580f3f18a252fdc67a" exitCode=0 Jul 08 12:14:52.940433 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:52.940388 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84ccc879c8-wtttg" Jul 08 12:14:52.940698 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:52.940425 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84ccc879c8-wtttg" event={"ID":"f5058dc3-6dac-4986-b78f-a1238091d030","Type":"ContainerDied","Data":"da2ca723d23fe6616e0ebcba190b35935518ca4e50c56b580f3f18a252fdc67a"} Jul 08 12:14:52.940698 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:52.940471 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84ccc879c8-wtttg" event={"ID":"f5058dc3-6dac-4986-b78f-a1238091d030","Type":"ContainerDied","Data":"7fdf2ccc567ece57987c472b3abb3432bff9d43d4d0eed9fa87340b4f22909f5"} Jul 08 12:14:52.940698 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:52.940497 2560 scope.go:117] "RemoveContainer" containerID="da2ca723d23fe6616e0ebcba190b35935518ca4e50c56b580f3f18a252fdc67a" Jul 08 12:14:52.949879 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:52.949857 2560 scope.go:117] "RemoveContainer" containerID="da2ca723d23fe6616e0ebcba190b35935518ca4e50c56b580f3f18a252fdc67a" Jul 08 12:14:52.950215 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:14:52.950197 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da2ca723d23fe6616e0ebcba190b35935518ca4e50c56b580f3f18a252fdc67a\": container with ID starting with da2ca723d23fe6616e0ebcba190b35935518ca4e50c56b580f3f18a252fdc67a not found: ID does not exist" containerID="da2ca723d23fe6616e0ebcba190b35935518ca4e50c56b580f3f18a252fdc67a" Jul 08 12:14:52.950286 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:52.950225 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da2ca723d23fe6616e0ebcba190b35935518ca4e50c56b580f3f18a252fdc67a"} err="failed to get container status \"da2ca723d23fe6616e0ebcba190b35935518ca4e50c56b580f3f18a252fdc67a\": rpc error: code = NotFound desc = could not find container \"da2ca723d23fe6616e0ebcba190b35935518ca4e50c56b580f3f18a252fdc67a\": container with ID starting with da2ca723d23fe6616e0ebcba190b35935518ca4e50c56b580f3f18a252fdc67a not found: ID does not exist" Jul 08 12:14:52.979776 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:52.979745 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84ccc879c8-wtttg"] Jul 08 12:14:52.993903 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:52.993871 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-84ccc879c8-wtttg"] Jul 08 12:14:53.136514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:53.136477 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5058dc3-6dac-4986-b78f-a1238091d030" path="/var/lib/kubelet/pods/f5058dc3-6dac-4986-b78f-a1238091d030/volumes" Jul 08 12:14:56.029304 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:14:56.029262 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:15:53.333031 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:15:53.332995 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:16:02.444872 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:16:02.444839 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:16:04.231244 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:16:04.231212 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:16:13.881080 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:16:13.881040 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:16:29.189786 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:16:29.189704 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:16:29.192475 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:16:29.192450 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:16:43.026180 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:16:43.026142 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:16:43.129285 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:16:43.129248 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:16:43.293898 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:16:43.293813 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:16:49.908857 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:16:49.908815 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:16:50.013824 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:16:50.013785 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:16:50.107433 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:16:50.107397 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:16:50.294397 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:16:50.294366 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:16:57.239231 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:16:57.239182 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:16:57.339022 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:16:57.338985 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:17:44.635288 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:17:44.635256 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:17:56.309399 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:17:56.309315 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:19:53.077018 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:19:53.076930 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:21:29.224553 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:21:29.224523 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:21:29.230154 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:21:29.230129 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:23:37.731123 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:23:37.731089 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:24:05.344129 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:24:05.344098 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:24:55.114267 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:24:55.114235 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:25:08.703108 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:25:08.703061 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:25:20.999109 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:25:20.999075 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:26:29.262852 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:26:29.262807 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:26:29.272875 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:26:29.272845 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:28:07.201557 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:07.201524 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:16.385666 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:16.385630 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:24.660115 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:24.660041 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:29.759388 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:29.759329 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:32.622439 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:32.622401 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:32.723118 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:32.723066 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:33.099791 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:33.099753 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:39.312329 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:39.312293 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:39.372996 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:39.372959 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:39.562252 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:39.562176 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:39.619528 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:39.619398 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:40.658197 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:40.658156 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:40.759169 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:40.759138 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:40.870626 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:40.870593 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:41.176594 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:41.176552 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:41.389744 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:41.389714 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:41.490171 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:41.490063 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:43.324934 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:43.324857 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:45.804096 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:45.804059 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:46.005953 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:46.005904 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:46.104151 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:46.104061 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:46.360351 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:46.360263 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:47.856056 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:47.856029 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:52.441492 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:52.441451 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:52.541848 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:52.541795 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:52.687511 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:52.687482 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:52.787100 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:52.787074 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:53.882410 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:53.882380 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:53.972249 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:53.972221 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:54.198764 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:54.198680 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:54.344797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:54.344764 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:54.828237 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:54.828199 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:54.933567 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:54.933535 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:55.997703 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:55.997666 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:58.926185 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:58.926151 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:28:59.413463 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:28:59.413430 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:05.100434 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:05.100399 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:05.209495 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:05.209456 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:07.411286 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:07.411247 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:12.302626 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:12.302595 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:12.388798 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:12.388761 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:12.535095 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:12.535061 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:12.633296 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:12.633199 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:13.657204 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:13.657166 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:13.786764 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:13.786735 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:13.871323 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:13.871296 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:14.474932 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:14.474887 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:14.576105 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:14.576067 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:14.688069 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:14.688030 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:15.512652 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:15.512622 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:18.112746 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:18.112713 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:18.348637 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:18.348606 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:18.450206 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:18.450111 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:18.590006 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:18.589977 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:20.293652 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:20.293618 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:25.308549 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:25.308514 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:25.412888 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:25.412853 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:25.816801 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:25.816742 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:25.915128 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:25.915085 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:26.014105 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:26.014074 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:27.528207 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:27.528161 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:35.458064 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:35.458027 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:35.570752 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:35.570717 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:35.678045 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:35.678011 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:35.770646 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:35.770617 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:29:36.311249 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:29:36.311216 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:02.271453 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:02.271420 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:09.430715 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:09.430684 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:09.538841 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:09.538799 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:09.631714 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:09.631679 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:19.047287 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:19.047251 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:19.149492 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:19.149453 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:25.559270 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:25.559235 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:32.025930 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:32.025873 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:32.082668 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:32.082637 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:32.155627 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:32.155592 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:32.254625 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:32.254593 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:42.875721 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:42.875687 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:43.574570 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:43.574535 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:49.790880 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:49.790846 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:49.892107 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:49.892064 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:49.991021 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:49.990970 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:50.050577 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:50.050490 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:50.826638 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:50.826603 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:50.924740 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:50.924707 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:51.025334 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:51.025304 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:52.762165 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:52.762132 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:58.896713 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:58.896657 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:58.955455 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:58.955423 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:30:59.634060 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:30:59.634024 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:05.671675 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:05.671639 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:05.772401 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:05.772356 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:05.914691 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:05.914658 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:06.228628 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:06.228596 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:06.610116 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:06.610087 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:08.993217 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:08.993179 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:09.082935 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:09.082891 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:09.139149 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:09.139115 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:09.835345 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:09.835308 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:09.935435 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:09.935397 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:13.511136 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:13.511105 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:14.196640 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:14.196595 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:14.295413 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:14.295383 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:14.618311 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:14.618280 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:21.000037 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:21.000005 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:21.057865 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:21.057831 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:21.442541 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:21.442452 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:21.804731 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:21.804694 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:21.906636 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:21.906605 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:25.876498 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:25.876470 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:25.977086 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:25.977055 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:28.074801 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:28.074761 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:28.509063 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:28.508970 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:28.562194 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:28.562159 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:28.695146 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:28.695111 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:28.793822 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:28.793787 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:28.934349 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:28.934314 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:29.302779 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:29.302753 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:31:29.311609 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:29.311585 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:31:35.264969 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:35.264936 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:35.371350 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:35.371313 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:35.460290 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:35.460261 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:35.608624 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:35.608535 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:41.937782 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:41.937741 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:42.501143 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:42.501095 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:48.726374 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:48.726328 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:49.054790 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:49.054755 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:49.237645 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:49.237615 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:52.206689 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:52.206627 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:52.344876 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:52.344841 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:52.442383 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:52.442344 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:52.545221 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:52.545189 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:52.771531 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:52.771496 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:52.873350 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:52.873253 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:31:56.689754 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:31:56.689718 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:32:16.724459 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.724416 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk"] Jul 08 12:32:16.725029 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.724989 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5058dc3-6dac-4986-b78f-a1238091d030" containerName="authorino" Jul 08 12:32:16.725029 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.725009 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5058dc3-6dac-4986-b78f-a1238091d030" containerName="authorino" Jul 08 12:32:16.725157 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.725109 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5058dc3-6dac-4986-b78f-a1238091d030" containerName="authorino" Jul 08 12:32:16.728154 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.728130 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:16.730784 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.730758 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-cbca5e6f\"/\"openshift-service-ca.crt\"" Jul 08 12:32:16.732047 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.732027 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-cbca5e6f\"/\"kube-root-ca.crt\"" Jul 08 12:32:16.732195 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.732085 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-cbca5e6f\"/\"default-dockercfg-w44lz\"" Jul 08 12:32:16.732195 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.732096 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-cbca5e6f\"/\"e2e-lifecycle-model-cbca5e6f-kserve-self-signed-certs\"" Jul 08 12:32:16.735972 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.735722 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk"] Jul 08 12:32:16.777926 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.777882 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-tmp-dir\") pod \"e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:16.778096 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.777943 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dce2cc1-9cc1-4807-90e7-27665df35b0c-tls-certs\") pod \"e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:16.778096 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.778071 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8f7v\" (UniqueName: \"kubernetes.io/projected/1dce2cc1-9cc1-4807-90e7-27665df35b0c-kube-api-access-t8f7v\") pod \"e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:16.778172 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.778119 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-home\") pod \"e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:16.778207 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.778178 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-dshm\") pod \"e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:16.778207 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.778202 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-model-cache\") pod \"e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:16.810796 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.810758 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:32:16.879106 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.879064 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-tmp-dir\") pod \"e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:16.879297 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.879117 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dce2cc1-9cc1-4807-90e7-27665df35b0c-tls-certs\") pod \"e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:16.879297 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.879165 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8f7v\" (UniqueName: \"kubernetes.io/projected/1dce2cc1-9cc1-4807-90e7-27665df35b0c-kube-api-access-t8f7v\") pod \"e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:16.879297 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.879185 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-home\") pod \"e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:16.879468 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.879324 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-dshm\") pod \"e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:16.879468 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.879363 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-model-cache\") pod \"e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:16.879580 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.879496 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-tmp-dir\") pod \"e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:16.879580 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.879530 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-home\") pod \"e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:16.879704 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.879684 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-model-cache\") pod \"e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:16.881514 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.881489 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-dshm\") pod \"e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:16.881763 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.881746 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dce2cc1-9cc1-4807-90e7-27665df35b0c-tls-certs\") pod \"e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:16.889007 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:16.888977 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8f7v\" (UniqueName: \"kubernetes.io/projected/1dce2cc1-9cc1-4807-90e7-27665df35b0c-kube-api-access-t8f7v\") pod \"e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:17.038349 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:17.038308 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:17.188848 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:17.188817 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk"] Jul 08 12:32:17.190240 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:32:17.190205 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dce2cc1_9cc1_4807_90e7_27665df35b0c.slice/crio-14024c52bd807010563bcfbdae008ffeebcb48214897192b3139b81107f5767e WatchSource:0}: Error finding container 14024c52bd807010563bcfbdae008ffeebcb48214897192b3139b81107f5767e: Status 404 returned error can't find the container with id 14024c52bd807010563bcfbdae008ffeebcb48214897192b3139b81107f5767e Jul 08 12:32:17.350841 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:17.350739 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" event={"ID":"1dce2cc1-9cc1-4807-90e7-27665df35b0c","Type":"ContainerStarted","Data":"116abf7de4576fc36adeb9d8a954cea1bb1ed0c4ad7c5007294cc77a939113f9"} Jul 08 12:32:17.350841 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:17.350790 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" event={"ID":"1dce2cc1-9cc1-4807-90e7-27665df35b0c","Type":"ContainerStarted","Data":"14024c52bd807010563bcfbdae008ffeebcb48214897192b3139b81107f5767e"} Jul 08 12:32:17.374756 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:17.374703 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" podStartSLOduration=1.374687284 podStartE2EDuration="1.374687284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:32:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:32:17.373862146 +0000 UTC m=+1848.733601454" watchObservedRunningTime="2026-07-08 12:32:17.374687284 +0000 UTC m=+1848.734426590" Jul 08 12:32:26.074654 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:26.074624 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:32:26.255814 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:26.255778 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:32:27.039108 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:27.039072 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:27.039322 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:27.039233 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:27.051678 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:27.051655 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:27.415503 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:27.415414 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:32:39.381401 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:39.381365 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:32:39.870036 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:39.870003 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:32:45.458732 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:45.458696 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:32:50.480541 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:50.480504 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk"] Jul 08 12:32:50.563827 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:32:50.563795 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:04.738847 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:04.738809 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:05.501066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.501017 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" podUID="1dce2cc1-9cc1-4807-90e7-27665df35b0c" containerName="main" containerID="cri-o://116abf7de4576fc36adeb9d8a954cea1bb1ed0c4ad7c5007294cc77a939113f9" gracePeriod=45 Jul 08 12:33:05.755351 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.755286 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:33:05.835222 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.835187 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dce2cc1-9cc1-4807-90e7-27665df35b0c-tls-certs\") pod \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " Jul 08 12:33:05.835222 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.835230 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-model-cache\") pod \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " Jul 08 12:33:05.835495 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.835249 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-home\") pod \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " Jul 08 12:33:05.835495 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.835276 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-dshm\") pod \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " Jul 08 12:33:05.835495 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.835311 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8f7v\" (UniqueName: \"kubernetes.io/projected/1dce2cc1-9cc1-4807-90e7-27665df35b0c-kube-api-access-t8f7v\") pod \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " Jul 08 12:33:05.835495 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.835426 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-tmp-dir\") pod \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\" (UID: \"1dce2cc1-9cc1-4807-90e7-27665df35b0c\") " Jul 08 12:33:05.835693 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.835552 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-model-cache" (OuterVolumeSpecName: "model-cache") pod "1dce2cc1-9cc1-4807-90e7-27665df35b0c" (UID: "1dce2cc1-9cc1-4807-90e7-27665df35b0c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:33:05.835693 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.835562 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-home" (OuterVolumeSpecName: "home") pod "1dce2cc1-9cc1-4807-90e7-27665df35b0c" (UID: "1dce2cc1-9cc1-4807-90e7-27665df35b0c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:33:05.835784 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.835725 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1dce2cc1-9cc1-4807-90e7-27665df35b0c" (UID: "1dce2cc1-9cc1-4807-90e7-27665df35b0c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:33:05.835831 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.835807 2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-home\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:33:05.835831 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.835820 2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-tmp-dir\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:33:05.835831 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.835829 2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-model-cache\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:33:05.837548 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.837522 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dce2cc1-9cc1-4807-90e7-27665df35b0c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1dce2cc1-9cc1-4807-90e7-27665df35b0c" (UID: "1dce2cc1-9cc1-4807-90e7-27665df35b0c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 12:33:05.837826 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.837797 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-dshm" (OuterVolumeSpecName: "dshm") pod "1dce2cc1-9cc1-4807-90e7-27665df35b0c" (UID: "1dce2cc1-9cc1-4807-90e7-27665df35b0c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:33:05.837941 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.837829 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dce2cc1-9cc1-4807-90e7-27665df35b0c-kube-api-access-t8f7v" (OuterVolumeSpecName: "kube-api-access-t8f7v") pod "1dce2cc1-9cc1-4807-90e7-27665df35b0c" (UID: "1dce2cc1-9cc1-4807-90e7-27665df35b0c"). InnerVolumeSpecName "kube-api-access-t8f7v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:33:05.937193 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.937150 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8f7v\" (UniqueName: \"kubernetes.io/projected/1dce2cc1-9cc1-4807-90e7-27665df35b0c-kube-api-access-t8f7v\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:33:05.937193 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.937186 2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dce2cc1-9cc1-4807-90e7-27665df35b0c-tls-certs\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:33:05.937193 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:05.937195 2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dce2cc1-9cc1-4807-90e7-27665df35b0c-dshm\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:33:06.603396 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:06.603355 2560 generic.go:356] "Generic (PLEG): container finished" podID="1dce2cc1-9cc1-4807-90e7-27665df35b0c" containerID="116abf7de4576fc36adeb9d8a954cea1bb1ed0c4ad7c5007294cc77a939113f9" exitCode=0 Jul 08 12:33:06.603604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:06.603411 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" Jul 08 12:33:06.603604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:06.603448 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" event={"ID":"1dce2cc1-9cc1-4807-90e7-27665df35b0c","Type":"ContainerDied","Data":"116abf7de4576fc36adeb9d8a954cea1bb1ed0c4ad7c5007294cc77a939113f9"} Jul 08 12:33:06.603604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:06.603501 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk" event={"ID":"1dce2cc1-9cc1-4807-90e7-27665df35b0c","Type":"ContainerDied","Data":"14024c52bd807010563bcfbdae008ffeebcb48214897192b3139b81107f5767e"} Jul 08 12:33:06.603604 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:06.603521 2560 scope.go:117] "RemoveContainer" containerID="116abf7de4576fc36adeb9d8a954cea1bb1ed0c4ad7c5007294cc77a939113f9" Jul 08 12:33:06.612807 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:06.612789 2560 scope.go:117] "RemoveContainer" containerID="116abf7de4576fc36adeb9d8a954cea1bb1ed0c4ad7c5007294cc77a939113f9" Jul 08 12:33:06.613071 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:33:06.613052 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"116abf7de4576fc36adeb9d8a954cea1bb1ed0c4ad7c5007294cc77a939113f9\": container with ID starting with 116abf7de4576fc36adeb9d8a954cea1bb1ed0c4ad7c5007294cc77a939113f9 not found: ID does not exist" containerID="116abf7de4576fc36adeb9d8a954cea1bb1ed0c4ad7c5007294cc77a939113f9" Jul 08 12:33:06.613124 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:06.613079 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"116abf7de4576fc36adeb9d8a954cea1bb1ed0c4ad7c5007294cc77a939113f9"} err="failed to get container status \"116abf7de4576fc36adeb9d8a954cea1bb1ed0c4ad7c5007294cc77a939113f9\": rpc error: code = NotFound desc = could not find container \"116abf7de4576fc36adeb9d8a954cea1bb1ed0c4ad7c5007294cc77a939113f9\": container with ID starting with 116abf7de4576fc36adeb9d8a954cea1bb1ed0c4ad7c5007294cc77a939113f9 not found: ID does not exist" Jul 08 12:33:06.626441 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:06.626412 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk"] Jul 08 12:33:06.630560 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:06.630533 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-cbca5e6f/e2e-lifecycle-model-cbca5e6f-kserve-6fcfb97679-zp7mk"] Jul 08 12:33:07.133024 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:07.132991 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dce2cc1-9cc1-4807-90e7-27665df35b0c" path="/var/lib/kubelet/pods/1dce2cc1-9cc1-4807-90e7-27665df35b0c/volumes" Jul 08 12:33:27.420850 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:27.420815 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:28.362564 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:28.362533 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:34.126064 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:34.126026 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:34.238413 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:34.238378 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:34.425378 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:34.425286 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:35.695748 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:35.695670 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:35.795881 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:35.795838 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:35.896663 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:35.896630 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:36.700260 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:36.700222 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:36.794109 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:36.794076 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:36.895968 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:36.895908 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:38.286630 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:38.286597 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:44.313522 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:44.313483 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:44.410108 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:44.410062 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:44.979063 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:44.979028 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:51.102744 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:51.102698 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:51.207117 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:51.207077 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:33:51.303457 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:33:51.303425 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:01.856928 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:01.856880 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:02.209501 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:02.209412 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:23.179281 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:23.179167 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:29.667223 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:29.667186 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:29.767939 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:29.767879 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:30.038350 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:30.038319 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:30.402238 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:30.402137 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:30.772324 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:30.772285 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:33.097518 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:33.097484 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:33.229244 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:33.229210 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:33.319489 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:33.319454 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:33.419153 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:33.419072 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:33.830199 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:33.830166 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:33.929126 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:33.929091 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:37.536222 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:37.536192 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:37.867126 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:37.867041 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:38.180376 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:38.180292 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:38.415425 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:38.415371 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:41.117152 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:41.117119 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:41.192215 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:41.192181 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:41.252755 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:41.252718 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:41.663724 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:41.663677 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:41.774192 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:41.774153 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:41.874870 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:41.874831 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:45.530538 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:45.530496 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:54.596265 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:54.596225 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:34:54.697094 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:34:54.697059 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:35:01.111703 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.111669 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2"] Jul 08 12:35:01.112087 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.112050 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dce2cc1-9cc1-4807-90e7-27665df35b0c" containerName="main" Jul 08 12:35:01.112087 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.112062 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dce2cc1-9cc1-4807-90e7-27665df35b0c" containerName="main" Jul 08 12:35:01.112158 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.112127 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dce2cc1-9cc1-4807-90e7-27665df35b0c" containerName="main" Jul 08 12:35:01.115134 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.115119 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.117943 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.117905 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-253a40\"/\"default-dockercfg-b24t4\"" Jul 08 12:35:01.118042 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.117905 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-253a40\"/\"kube-root-ca.crt\"" Jul 08 12:35:01.118848 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.118833 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-253a40\"/\"openshift-service-ca.crt\"" Jul 08 12:35:01.118944 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.118926 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-253a40\"/\"test-model-253a40-kserve-self-signed-certs\"" Jul 08 12:35:01.133743 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.133712 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:35:01.138724 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.138703 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2"] Jul 08 12:35:01.162205 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.162171 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-home\") pod \"test-model-253a40-kserve-5c4499ff95-7vtl2\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.162355 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.162215 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-dshm\") pod \"test-model-253a40-kserve-5c4499ff95-7vtl2\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.162355 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.162315 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-tmp-dir\") pod \"test-model-253a40-kserve-5c4499ff95-7vtl2\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.162355 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.162341 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/376e770f-533f-4aef-9587-8ca91e5f3652-tls-certs\") pod \"test-model-253a40-kserve-5c4499ff95-7vtl2\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.162463 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.162364 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm87h\" (UniqueName: \"kubernetes.io/projected/376e770f-533f-4aef-9587-8ca91e5f3652-kube-api-access-bm87h\") pod \"test-model-253a40-kserve-5c4499ff95-7vtl2\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.162463 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.162397 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-model-cache\") pod \"test-model-253a40-kserve-5c4499ff95-7vtl2\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.263788 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.263745 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-model-cache\") pod \"test-model-253a40-kserve-5c4499ff95-7vtl2\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.263995 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.263801 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-home\") pod \"test-model-253a40-kserve-5c4499ff95-7vtl2\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.263995 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.263826 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-dshm\") pod \"test-model-253a40-kserve-5c4499ff95-7vtl2\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.263995 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.263876 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-tmp-dir\") pod \"test-model-253a40-kserve-5c4499ff95-7vtl2\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.263995 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.263892 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/376e770f-533f-4aef-9587-8ca91e5f3652-tls-certs\") pod \"test-model-253a40-kserve-5c4499ff95-7vtl2\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.264152 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.263986 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm87h\" (UniqueName: \"kubernetes.io/projected/376e770f-533f-4aef-9587-8ca91e5f3652-kube-api-access-bm87h\") pod \"test-model-253a40-kserve-5c4499ff95-7vtl2\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.264265 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.264244 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-model-cache\") pod \"test-model-253a40-kserve-5c4499ff95-7vtl2\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.264392 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.264278 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-home\") pod \"test-model-253a40-kserve-5c4499ff95-7vtl2\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.264392 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.264308 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-tmp-dir\") pod \"test-model-253a40-kserve-5c4499ff95-7vtl2\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.266170 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.266146 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-dshm\") pod \"test-model-253a40-kserve-5c4499ff95-7vtl2\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.266404 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.266390 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/376e770f-533f-4aef-9587-8ca91e5f3652-tls-certs\") pod \"test-model-253a40-kserve-5c4499ff95-7vtl2\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.274851 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.274827 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm87h\" (UniqueName: \"kubernetes.io/projected/376e770f-533f-4aef-9587-8ca91e5f3652-kube-api-access-bm87h\") pod \"test-model-253a40-kserve-5c4499ff95-7vtl2\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.426022 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.425895 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:01.560033 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:01.560007 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2"] Jul 08 12:35:01.561690 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:35:01.561664 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod376e770f_533f_4aef_9587_8ca91e5f3652.slice/crio-63216f23bdf74ecf227c2f4d19be8c43bb98cdeb288e7c2804fd2230a7808737 WatchSource:0}: Error finding container 63216f23bdf74ecf227c2f4d19be8c43bb98cdeb288e7c2804fd2230a7808737: Status 404 returned error can't find the container with id 63216f23bdf74ecf227c2f4d19be8c43bb98cdeb288e7c2804fd2230a7808737 Jul 08 12:35:02.198795 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:02.198761 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" event={"ID":"376e770f-533f-4aef-9587-8ca91e5f3652","Type":"ContainerStarted","Data":"10b06448a9b2054b70cfd0b53107359c8ded55fcd05a0179effcc3841d69462f"} Jul 08 12:35:02.198795 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:02.198801 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" event={"ID":"376e770f-533f-4aef-9587-8ca91e5f3652","Type":"ContainerStarted","Data":"63216f23bdf74ecf227c2f4d19be8c43bb98cdeb288e7c2804fd2230a7808737"} Jul 08 12:35:02.221567 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:02.221516 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" podStartSLOduration=1.221502365 podStartE2EDuration="1.221502365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:35:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:35:02.218939598 +0000 UTC m=+2013.578678908" watchObservedRunningTime="2026-07-08 12:35:02.221502365 +0000 UTC m=+2013.581241671" Jul 08 12:35:03.548727 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:03.548682 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:35:03.666712 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:03.666679 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:35:11.426595 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:11.426558 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:11.427025 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:11.426614 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:11.439081 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:11.439057 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:12.262204 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:12.262177 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:35:28.227386 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.227344 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs"] Jul 08 12:35:28.230894 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.230877 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.235824 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.235803 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-85707a\"/\"kube-root-ca.crt\"" Jul 08 12:35:28.236763 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.236744 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-85707a\"/\"openshift-service-ca.crt\"" Jul 08 12:35:28.236884 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.236773 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-85707a\"/\"test-model-85707a-kserve-self-signed-certs\"" Jul 08 12:35:28.237042 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.237021 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-85707a\"/\"default-dockercfg-t4svx\"" Jul 08 12:35:28.243147 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.243120 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs"] Jul 08 12:35:28.250718 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.250693 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:35:28.309218 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.309178 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-dshm\") pod \"test-model-85707a-kserve-5d5475c89c-kffzs\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.309218 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.309218 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-home\") pod \"test-model-85707a-kserve-5d5475c89c-kffzs\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.309425 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.309242 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-tmp-dir\") pod \"test-model-85707a-kserve-5d5475c89c-kffzs\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.309425 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.309327 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-model-cache\") pod \"test-model-85707a-kserve-5d5475c89c-kffzs\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.309425 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.309410 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzwhg\" (UniqueName: \"kubernetes.io/projected/a91c2f37-6022-4ea4-86f0-004fa2a824d6-kube-api-access-rzwhg\") pod \"test-model-85707a-kserve-5d5475c89c-kffzs\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.309544 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.309431 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a91c2f37-6022-4ea4-86f0-004fa2a824d6-tls-certs\") pod \"test-model-85707a-kserve-5d5475c89c-kffzs\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.410567 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.410532 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-model-cache\") pod \"test-model-85707a-kserve-5d5475c89c-kffzs\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.410754 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.410611 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzwhg\" (UniqueName: \"kubernetes.io/projected/a91c2f37-6022-4ea4-86f0-004fa2a824d6-kube-api-access-rzwhg\") pod \"test-model-85707a-kserve-5d5475c89c-kffzs\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.410754 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.410631 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a91c2f37-6022-4ea4-86f0-004fa2a824d6-tls-certs\") pod \"test-model-85707a-kserve-5d5475c89c-kffzs\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.410754 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.410664 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-dshm\") pod \"test-model-85707a-kserve-5d5475c89c-kffzs\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.410754 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.410682 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-home\") pod \"test-model-85707a-kserve-5d5475c89c-kffzs\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.410754 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.410703 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-tmp-dir\") pod \"test-model-85707a-kserve-5d5475c89c-kffzs\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.411090 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.411038 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-model-cache\") pod \"test-model-85707a-kserve-5d5475c89c-kffzs\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.411144 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.411080 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-home\") pod \"test-model-85707a-kserve-5d5475c89c-kffzs\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.411144 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.411122 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-tmp-dir\") pod \"test-model-85707a-kserve-5d5475c89c-kffzs\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.412972 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.412953 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-dshm\") pod \"test-model-85707a-kserve-5d5475c89c-kffzs\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.413124 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.413107 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a91c2f37-6022-4ea4-86f0-004fa2a824d6-tls-certs\") pod \"test-model-85707a-kserve-5d5475c89c-kffzs\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.420719 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.420694 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzwhg\" (UniqueName: \"kubernetes.io/projected/a91c2f37-6022-4ea4-86f0-004fa2a824d6-kube-api-access-rzwhg\") pod \"test-model-85707a-kserve-5d5475c89c-kffzs\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.541079 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.541043 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:28.676370 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:28.676343 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs"] Jul 08 12:35:28.677806 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:35:28.677775 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda91c2f37_6022_4ea4_86f0_004fa2a824d6.slice/crio-c3f17e166450ee32ec8b647150d833779be439171531076c5dc6c3d1a200fc17 WatchSource:0}: Error finding container c3f17e166450ee32ec8b647150d833779be439171531076c5dc6c3d1a200fc17: Status 404 returned error can't find the container with id c3f17e166450ee32ec8b647150d833779be439171531076c5dc6c3d1a200fc17 Jul 08 12:35:29.338315 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:29.338273 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" event={"ID":"a91c2f37-6022-4ea4-86f0-004fa2a824d6","Type":"ContainerStarted","Data":"599085224b26e2b26b6bd22949b99ce36138b43529f036429b7213beed97f7cc"} Jul 08 12:35:29.338674 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:29.338324 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" event={"ID":"a91c2f37-6022-4ea4-86f0-004fa2a824d6","Type":"ContainerStarted","Data":"c3f17e166450ee32ec8b647150d833779be439171531076c5dc6c3d1a200fc17"} Jul 08 12:35:29.357896 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:29.357795 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" podStartSLOduration=1.357774411 podStartE2EDuration="1.357774411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:35:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:35:29.357624303 +0000 UTC m=+2040.717363611" watchObservedRunningTime="2026-07-08 12:35:29.357774411 +0000 UTC m=+2040.717513719" Jul 08 12:35:38.541503 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:38.541460 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:38.542068 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:38.541551 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:38.554324 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:38.554300 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:35:39.402360 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:35:39.402330 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:36:15.450289 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:15.450252 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2"] Jul 08 12:36:15.475962 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:15.475930 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:36:16.343692 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:16.343652 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs"] Jul 08 12:36:16.359856 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:16.359825 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:36:16.525599 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:16.525566 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:36:16.926598 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:16.926513 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:36:17.035444 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:17.035412 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:36:17.131177 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:17.131144 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:36:17.293048 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:17.293010 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:36:22.003539 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:22.003508 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:36:26.238511 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:26.238475 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:36:26.630945 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:26.630870 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:36:26.732181 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:26.732124 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:36:29.340095 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:29.340056 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:36:29.348977 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:29.348950 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:36:30.470080 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.470022 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" podUID="376e770f-533f-4aef-9587-8ca91e5f3652" containerName="main" containerID="cri-o://10b06448a9b2054b70cfd0b53107359c8ded55fcd05a0179effcc3841d69462f" gracePeriod=45 Jul 08 12:36:30.671642 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.671609 2560 generic.go:356] "Generic (PLEG): container finished" podID="376e770f-533f-4aef-9587-8ca91e5f3652" containerID="10b06448a9b2054b70cfd0b53107359c8ded55fcd05a0179effcc3841d69462f" exitCode=0 Jul 08 12:36:30.671791 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.671667 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" event={"ID":"376e770f-533f-4aef-9587-8ca91e5f3652","Type":"ContainerDied","Data":"10b06448a9b2054b70cfd0b53107359c8ded55fcd05a0179effcc3841d69462f"} Jul 08 12:36:30.723180 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.723122 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:36:30.803431 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.803392 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-model-cache\") pod \"376e770f-533f-4aef-9587-8ca91e5f3652\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " Jul 08 12:36:30.803634 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.803467 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-home\") pod \"376e770f-533f-4aef-9587-8ca91e5f3652\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " Jul 08 12:36:30.803634 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.803497 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm87h\" (UniqueName: \"kubernetes.io/projected/376e770f-533f-4aef-9587-8ca91e5f3652-kube-api-access-bm87h\") pod \"376e770f-533f-4aef-9587-8ca91e5f3652\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " Jul 08 12:36:30.803634 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.803518 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-tmp-dir\") pod \"376e770f-533f-4aef-9587-8ca91e5f3652\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " Jul 08 12:36:30.803634 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.803543 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-dshm\") pod \"376e770f-533f-4aef-9587-8ca91e5f3652\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " Jul 08 12:36:30.803634 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.803582 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/376e770f-533f-4aef-9587-8ca91e5f3652-tls-certs\") pod \"376e770f-533f-4aef-9587-8ca91e5f3652\" (UID: \"376e770f-533f-4aef-9587-8ca91e5f3652\") " Jul 08 12:36:30.803896 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.803760 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-model-cache" (OuterVolumeSpecName: "model-cache") pod "376e770f-533f-4aef-9587-8ca91e5f3652" (UID: "376e770f-533f-4aef-9587-8ca91e5f3652"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:36:30.803896 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.803781 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-home" (OuterVolumeSpecName: "home") pod "376e770f-533f-4aef-9587-8ca91e5f3652" (UID: "376e770f-533f-4aef-9587-8ca91e5f3652"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:36:30.803896 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.803801 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "376e770f-533f-4aef-9587-8ca91e5f3652" (UID: "376e770f-533f-4aef-9587-8ca91e5f3652"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:36:30.803896 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.803874 2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-model-cache\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:36:30.803896 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.803892 2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-home\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:36:30.804105 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.803906 2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-tmp-dir\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:36:30.805889 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.805864 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/376e770f-533f-4aef-9587-8ca91e5f3652-kube-api-access-bm87h" (OuterVolumeSpecName: "kube-api-access-bm87h") pod "376e770f-533f-4aef-9587-8ca91e5f3652" (UID: "376e770f-533f-4aef-9587-8ca91e5f3652"). InnerVolumeSpecName "kube-api-access-bm87h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:36:30.805992 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.805903 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/376e770f-533f-4aef-9587-8ca91e5f3652-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "376e770f-533f-4aef-9587-8ca91e5f3652" (UID: "376e770f-533f-4aef-9587-8ca91e5f3652"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 12:36:30.805992 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.805973 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-dshm" (OuterVolumeSpecName: "dshm") pod "376e770f-533f-4aef-9587-8ca91e5f3652" (UID: "376e770f-533f-4aef-9587-8ca91e5f3652"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:36:30.905315 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.905271 2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/376e770f-533f-4aef-9587-8ca91e5f3652-tls-certs\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:36:30.905315 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.905304 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm87h\" (UniqueName: \"kubernetes.io/projected/376e770f-533f-4aef-9587-8ca91e5f3652-kube-api-access-bm87h\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:36:30.905315 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:30.905315 2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/376e770f-533f-4aef-9587-8ca91e5f3652-dshm\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:36:31.364093 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.364050 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" podUID="a91c2f37-6022-4ea4-86f0-004fa2a824d6" containerName="main" containerID="cri-o://599085224b26e2b26b6bd22949b99ce36138b43529f036429b7213beed97f7cc" gracePeriod=45 Jul 08 12:36:31.630277 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.630248 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:36:31.678305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.678267 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" event={"ID":"376e770f-533f-4aef-9587-8ca91e5f3652","Type":"ContainerDied","Data":"63216f23bdf74ecf227c2f4d19be8c43bb98cdeb288e7c2804fd2230a7808737"} Jul 08 12:36:31.678305 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.678277 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2" Jul 08 12:36:31.678547 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.678319 2560 scope.go:117] "RemoveContainer" containerID="10b06448a9b2054b70cfd0b53107359c8ded55fcd05a0179effcc3841d69462f" Jul 08 12:36:31.679674 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.679651 2560 generic.go:356] "Generic (PLEG): container finished" podID="a91c2f37-6022-4ea4-86f0-004fa2a824d6" containerID="599085224b26e2b26b6bd22949b99ce36138b43529f036429b7213beed97f7cc" exitCode=0 Jul 08 12:36:31.679777 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.679688 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" event={"ID":"a91c2f37-6022-4ea4-86f0-004fa2a824d6","Type":"ContainerDied","Data":"599085224b26e2b26b6bd22949b99ce36138b43529f036429b7213beed97f7cc"} Jul 08 12:36:31.679777 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.679731 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" event={"ID":"a91c2f37-6022-4ea4-86f0-004fa2a824d6","Type":"ContainerDied","Data":"c3f17e166450ee32ec8b647150d833779be439171531076c5dc6c3d1a200fc17"} Jul 08 12:36:31.679777 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.679703 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs" Jul 08 12:36:31.687322 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.687302 2560 scope.go:117] "RemoveContainer" containerID="599085224b26e2b26b6bd22949b99ce36138b43529f036429b7213beed97f7cc" Jul 08 12:36:31.695360 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.695345 2560 scope.go:117] "RemoveContainer" containerID="599085224b26e2b26b6bd22949b99ce36138b43529f036429b7213beed97f7cc" Jul 08 12:36:31.695617 ip-10-0-137-232 kubenswrapper[2560]: E0708 12:36:31.695597 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"599085224b26e2b26b6bd22949b99ce36138b43529f036429b7213beed97f7cc\": container with ID starting with 599085224b26e2b26b6bd22949b99ce36138b43529f036429b7213beed97f7cc not found: ID does not exist" containerID="599085224b26e2b26b6bd22949b99ce36138b43529f036429b7213beed97f7cc" Jul 08 12:36:31.695659 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.695626 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"599085224b26e2b26b6bd22949b99ce36138b43529f036429b7213beed97f7cc"} err="failed to get container status \"599085224b26e2b26b6bd22949b99ce36138b43529f036429b7213beed97f7cc\": rpc error: code = NotFound desc = could not find container \"599085224b26e2b26b6bd22949b99ce36138b43529f036429b7213beed97f7cc\": container with ID starting with 599085224b26e2b26b6bd22949b99ce36138b43529f036429b7213beed97f7cc not found: ID does not exist" Jul 08 12:36:31.704685 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.704659 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2"] Jul 08 12:36:31.709859 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.709835 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-253a40/test-model-253a40-kserve-5c4499ff95-7vtl2"] Jul 08 12:36:31.713788 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.713771 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-dshm\") pod \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " Jul 08 12:36:31.713856 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.713807 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-model-cache\") pod \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " Jul 08 12:36:31.713856 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.713843 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-tmp-dir\") pod \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " Jul 08 12:36:31.713955 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.713887 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-home\") pod \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " Jul 08 12:36:31.713955 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.713905 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzwhg\" (UniqueName: \"kubernetes.io/projected/a91c2f37-6022-4ea4-86f0-004fa2a824d6-kube-api-access-rzwhg\") pod \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " Jul 08 12:36:31.714066 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.713974 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a91c2f37-6022-4ea4-86f0-004fa2a824d6-tls-certs\") pod \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\" (UID: \"a91c2f37-6022-4ea4-86f0-004fa2a824d6\") " Jul 08 12:36:31.714133 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.714108 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-model-cache" (OuterVolumeSpecName: "model-cache") pod "a91c2f37-6022-4ea4-86f0-004fa2a824d6" (UID: "a91c2f37-6022-4ea4-86f0-004fa2a824d6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:36:31.714213 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.714188 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a91c2f37-6022-4ea4-86f0-004fa2a824d6" (UID: "a91c2f37-6022-4ea4-86f0-004fa2a824d6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:36:31.714259 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.714202 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-home" (OuterVolumeSpecName: "home") pod "a91c2f37-6022-4ea4-86f0-004fa2a824d6" (UID: "a91c2f37-6022-4ea4-86f0-004fa2a824d6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:36:31.714315 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.714300 2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-model-cache\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:36:31.714353 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.714334 2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-tmp-dir\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:36:31.714353 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.714343 2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-home\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:36:31.716191 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.716163 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a91c2f37-6022-4ea4-86f0-004fa2a824d6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a91c2f37-6022-4ea4-86f0-004fa2a824d6" (UID: "a91c2f37-6022-4ea4-86f0-004fa2a824d6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 12:36:31.716191 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.716173 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a91c2f37-6022-4ea4-86f0-004fa2a824d6-kube-api-access-rzwhg" (OuterVolumeSpecName: "kube-api-access-rzwhg") pod "a91c2f37-6022-4ea4-86f0-004fa2a824d6" (UID: "a91c2f37-6022-4ea4-86f0-004fa2a824d6"). InnerVolumeSpecName "kube-api-access-rzwhg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 12:36:31.716367 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.716216 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-dshm" (OuterVolumeSpecName: "dshm") pod "a91c2f37-6022-4ea4-86f0-004fa2a824d6" (UID: "a91c2f37-6022-4ea4-86f0-004fa2a824d6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 12:36:31.815771 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.815735 2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a91c2f37-6022-4ea4-86f0-004fa2a824d6-dshm\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:36:31.815771 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.815766 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzwhg\" (UniqueName: \"kubernetes.io/projected/a91c2f37-6022-4ea4-86f0-004fa2a824d6-kube-api-access-rzwhg\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:36:31.815771 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:31.815777 2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a91c2f37-6022-4ea4-86f0-004fa2a824d6-tls-certs\") on node \"ip-10-0-137-232.ec2.internal\" DevicePath \"\"" Jul 08 12:36:32.006416 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:32.006385 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs"] Jul 08 12:36:32.008484 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:32.008462 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-85707a/test-model-85707a-kserve-5d5475c89c-kffzs"] Jul 08 12:36:33.133681 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:33.133638 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="376e770f-533f-4aef-9587-8ca91e5f3652" path="/var/lib/kubelet/pods/376e770f-533f-4aef-9587-8ca91e5f3652/volumes" Jul 08 12:36:33.134234 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:33.134213 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a91c2f37-6022-4ea4-86f0-004fa2a824d6" path="/var/lib/kubelet/pods/a91c2f37-6022-4ea4-86f0-004fa2a824d6/volumes" Jul 08 12:36:59.657023 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:59.656993 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:36:59.947759 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:36:59.947666 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:00.341894 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:00.341846 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:00.767247 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:00.767213 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:00.915585 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:00.915550 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:01.015435 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:01.015407 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:01.190122 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:01.190034 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:06.943046 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:06.943008 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:07.040811 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:07.040769 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:07.201603 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:07.201517 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:07.791624 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:07.791589 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:08.124808 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:08.124705 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:08.269439 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:08.269409 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:10.800135 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:10.800100 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:10.897103 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:10.897053 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:10.993718 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:10.993675 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:11.093903 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:11.093807 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:11.488881 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:11.488789 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:11.589297 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:11.589268 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:15.317570 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:15.317539 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:15.807384 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:15.807343 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:16.166133 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:16.166049 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:16.241334 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:16.241302 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:18.864092 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:18.864057 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:18.963413 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:18.963377 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:19.154819 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:19.154731 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:19.361517 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:19.361487 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:19.704638 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:19.704597 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:19.804455 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:19.804428 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:23.375111 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:23.375029 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:31.498394 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:31.498359 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:31.923166 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:31.923110 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:32.165714 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:32.165669 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:32.264444 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:32.264411 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:32.408961 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:32.408921 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:38.037391 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:38.037348 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:38.103175 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:38.103141 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:38.302144 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:38.302039 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:38.687840 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:38.687741 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:39.094662 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:39.094630 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:39.208494 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:39.208463 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:39.313056 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:39.313023 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:39.574298 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:39.574263 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:45.550234 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:45.550197 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:45.659009 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:45.658965 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:45.831971 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:45.831836 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:46.389630 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:46.389597 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:46.702028 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:46.701944 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:47.021958 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:47.021868 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:50.047327 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:50.047285 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:50.132062 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:50.132032 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:50.196373 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:50.196336 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:50.458719 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:50.458628 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:50.737354 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:50.737257 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:50.838044 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:50.838011 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:54.533011 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:54.532976 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:54.876313 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:54.876227 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:55.202771 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:55.202686 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:56.645108 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:56.645074 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:58.089675 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:58.089635 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:58.166729 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:58.166699 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:58.223015 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:58.222985 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:58.357787 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:58.357701 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:58.698263 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:58.698176 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:37:58.799794 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:37:58.799762 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:38:02.602311 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:38:02.602280 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:38:12.533158 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:38:12.533113 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:38:12.633673 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:38:12.633632 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:38:19.714702 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:38:19.714664 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:38:19.814982 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:38:19.814953 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:38:42.325839 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:38:42.325803 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:38:52.761843 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:38:52.761764 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:39:46.278957 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:39:46.278904 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:40:40.993658 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:40:40.993573 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:40:42.387970 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:40:42.387936 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:07.721897 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:07.721864 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:08.146885 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:08.146851 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:08.247493 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:08.247457 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:08.347475 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:08.347442 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:14.511999 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:14.511965 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:14.566692 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:14.566660 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:14.770032 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:14.769951 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:15.189745 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:15.189654 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:15.608928 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:15.608876 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:15.708829 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:15.708793 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:15.809653 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:15.809621 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:16.002480 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:16.002393 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:19.228984 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:19.228950 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:21.659783 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:21.659746 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:21.759672 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:21.759638 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:21.924314 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:21.924226 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:22.701330 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:22.701289 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6dbfc7956c-hzhch_27b7c4f8-c08d-44b8-9c65-45a7dd11762e/authorino/0.log" Jul 08 12:41:27.532222 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:27.532184 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:27.632574 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:27.632538 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:27.750436 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:27.750411 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-f25kr_0f10b1bb-58b6-4a02-ab16-d75f3e4551ad/server/0.log" Jul 08 12:41:27.876692 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:27.876610 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-694hd_4ec4bbe5-522e-4caf-8005-6fdcd5601001/manager/0.log" Jul 08 12:41:27.992785 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:27.992758 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6db55b68b6-85fkl_7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9/copy-manifests/0.log" Jul 08 12:41:28.004983 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:28.004954 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6db55b68b6-85fkl_7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9/manager/0.log" Jul 08 12:41:29.052680 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:29.052653 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc_49de7306-7c31-4fa1-b9d3-3aec7a57f7d2/extract/0.log" Jul 08 12:41:29.059730 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:29.059702 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc_49de7306-7c31-4fa1-b9d3-3aec7a57f7d2/util/0.log" Jul 08 12:41:29.066987 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:29.066958 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc_49de7306-7c31-4fa1-b9d3-3aec7a57f7d2/pull/0.log" Jul 08 12:41:29.186378 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:29.186334 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl_efa39d73-ef69-4b84-b40c-7b51aa7dae46/util/0.log" Jul 08 12:41:29.193777 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:29.193751 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl_efa39d73-ef69-4b84-b40c-7b51aa7dae46/pull/0.log" Jul 08 12:41:29.202044 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:29.202024 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl_efa39d73-ef69-4b84-b40c-7b51aa7dae46/extract/0.log" Jul 08 12:41:29.314482 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:29.314409 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn_ae6e7c25-d0f2-4a43-83d8-367eac7928c4/util/0.log" Jul 08 12:41:29.322353 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:29.322326 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn_ae6e7c25-d0f2-4a43-83d8-367eac7928c4/pull/0.log" Jul 08 12:41:29.329133 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:29.329109 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn_ae6e7c25-d0f2-4a43-83d8-367eac7928c4/extract/0.log" Jul 08 12:41:29.374582 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:29.374556 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:41:29.383376 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:29.383354 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:41:29.444236 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:29.444210 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb_f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a/util/0.log" Jul 08 12:41:29.451166 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:29.451138 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb_f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a/pull/0.log" Jul 08 12:41:29.458042 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:29.458022 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb_f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a/extract/0.log" Jul 08 12:41:29.574752 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:29.574673 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6dbfc7956c-hzhch_27b7c4f8-c08d-44b8-9c65-45a7dd11762e/authorino/0.log" Jul 08 12:41:30.736483 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:30.736457 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mpnj4_48751fbb-ce21-4b1b-a741-b0129b72b287/istio-proxy/0.log" Jul 08 12:41:31.078714 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:31.078666 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-765c5b48c6-vtbsx_3dd3cf00-05d6-495f-ba49-be9111a615f1/kube-auth-proxy/0.log" Jul 08 12:41:32.140161 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:32.140130 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-kjfx7_81e694c1-22a5-4ac2-9f7c-c87d46aabd09/main/0.log" Jul 08 12:41:32.478174 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:32.478098 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-dl7kz_e2dfbc88-6829-43ef-bf92-e47d821cbfb3/main/0.log" Jul 08 12:41:36.334398 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.334362 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-drpcz/must-gather-rb2vw"] Jul 08 12:41:36.334811 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.334735 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a91c2f37-6022-4ea4-86f0-004fa2a824d6" containerName="main" Jul 08 12:41:36.334811 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.334746 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a91c2f37-6022-4ea4-86f0-004fa2a824d6" containerName="main" Jul 08 12:41:36.334811 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.334765 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="376e770f-533f-4aef-9587-8ca91e5f3652" containerName="main" Jul 08 12:41:36.334811 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.334771 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="376e770f-533f-4aef-9587-8ca91e5f3652" containerName="main" Jul 08 12:41:36.335009 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.334831 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="376e770f-533f-4aef-9587-8ca91e5f3652" containerName="main" Jul 08 12:41:36.335009 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.334841 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a91c2f37-6022-4ea4-86f0-004fa2a824d6" containerName="main" Jul 08 12:41:36.337963 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.337942 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-drpcz/must-gather-rb2vw" Jul 08 12:41:36.340266 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.340245 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:36.340536 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.340518 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-drpcz\"/\"kube-root-ca.crt\"" Jul 08 12:41:36.340812 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.340793 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-drpcz\"/\"default-dockercfg-8xw2t\"" Jul 08 12:41:36.340812 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.340809 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-drpcz\"/\"openshift-service-ca.crt\"" Jul 08 12:41:36.348135 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.348114 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-drpcz/must-gather-rb2vw"] Jul 08 12:41:36.404355 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.404320 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5399e19a-824d-4e7c-9c62-f155983f637c-must-gather-output\") pod \"must-gather-rb2vw\" (UID: \"5399e19a-824d-4e7c-9c62-f155983f637c\") " pod="openshift-must-gather-drpcz/must-gather-rb2vw" Jul 08 12:41:36.404530 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.404362 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5mpk\" (UniqueName: \"kubernetes.io/projected/5399e19a-824d-4e7c-9c62-f155983f637c-kube-api-access-j5mpk\") pod \"must-gather-rb2vw\" (UID: \"5399e19a-824d-4e7c-9c62-f155983f637c\") " pod="openshift-must-gather-drpcz/must-gather-rb2vw" Jul 08 12:41:36.438134 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.438105 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" limit=1024 Jul 08 12:41:36.505710 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.505672 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5399e19a-824d-4e7c-9c62-f155983f637c-must-gather-output\") pod \"must-gather-rb2vw\" (UID: \"5399e19a-824d-4e7c-9c62-f155983f637c\") " pod="openshift-must-gather-drpcz/must-gather-rb2vw" Jul 08 12:41:36.505870 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.505728 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5mpk\" (UniqueName: \"kubernetes.io/projected/5399e19a-824d-4e7c-9c62-f155983f637c-kube-api-access-j5mpk\") pod \"must-gather-rb2vw\" (UID: \"5399e19a-824d-4e7c-9c62-f155983f637c\") " pod="openshift-must-gather-drpcz/must-gather-rb2vw" Jul 08 12:41:36.506064 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.506047 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5399e19a-824d-4e7c-9c62-f155983f637c-must-gather-output\") pod \"must-gather-rb2vw\" (UID: \"5399e19a-824d-4e7c-9c62-f155983f637c\") " pod="openshift-must-gather-drpcz/must-gather-rb2vw" Jul 08 12:41:36.514738 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.514713 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5mpk\" (UniqueName: \"kubernetes.io/projected/5399e19a-824d-4e7c-9c62-f155983f637c-kube-api-access-j5mpk\") pod \"must-gather-rb2vw\" (UID: \"5399e19a-824d-4e7c-9c62-f155983f637c\") " pod="openshift-must-gather-drpcz/must-gather-rb2vw" Jul 08 12:41:36.647973 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.647841 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-drpcz/must-gather-rb2vw" Jul 08 12:41:36.784556 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.784527 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-drpcz/must-gather-rb2vw"] Jul 08 12:41:36.790097 ip-10-0-137-232 kubenswrapper[2560]: W0708 12:41:36.790065 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5399e19a_824d_4e7c_9c62_f155983f637c.slice/crio-27a9679297ed071493f6affe24241f7a4509c8384c2123e90f9e1a8d04b5f8c8 WatchSource:0}: Error finding container 27a9679297ed071493f6affe24241f7a4509c8384c2123e90f9e1a8d04b5f8c8: Status 404 returned error can't find the container with id 27a9679297ed071493f6affe24241f7a4509c8384c2123e90f9e1a8d04b5f8c8 Jul 08 12:41:36.792359 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:36.792340 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 12:41:37.248634 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:37.248595 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-drpcz/must-gather-rb2vw" event={"ID":"5399e19a-824d-4e7c-9c62-f155983f637c","Type":"ContainerStarted","Data":"27a9679297ed071493f6affe24241f7a4509c8384c2123e90f9e1a8d04b5f8c8"} Jul 08 12:41:39.263016 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:39.262972 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-drpcz/must-gather-rb2vw" event={"ID":"5399e19a-824d-4e7c-9c62-f155983f637c","Type":"ContainerStarted","Data":"6f5ad14457cba2e5b8ba6141900080679fdc33d80fd92a11fe62b18c6a1a33cc"} Jul 08 12:41:39.263560 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:39.263032 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-drpcz/must-gather-rb2vw" event={"ID":"5399e19a-824d-4e7c-9c62-f155983f637c","Type":"ContainerStarted","Data":"16a688db371425b89474f82213120a1c789f964cdbea9ed78cc691c2c737f441"} Jul 08 12:41:39.280679 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:39.280613 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-drpcz/must-gather-rb2vw" podStartSLOduration=1.918837714 podStartE2EDuration="3.280595764s" totalImagesPullingTime="1.36175805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 12:41:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:41:39.280080385 +0000 UTC m=+2410.639819692" watchObservedRunningTime="2026-07-08 12:41:39.280595764 +0000 UTC m=+2410.640335070" Jul 08 12:41:39.855802 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:39.855776 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6htjr_7796cb1f-125d-4404-9bb3-bb8bb21fa848/global-pull-secret-syncer/0.log" Jul 08 12:41:40.073787 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:40.073753 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2f2k6_bade0a1b-cb4c-4c2b-97dd-1d2844722dfb/konnectivity-agent/0.log" Jul 08 12:41:40.215569 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:40.215484 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-232.ec2.internal_fee1293dc92637ea42dbdc8f05630726/haproxy/0.log" Jul 08 12:41:44.781754 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:44.781702 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc_49de7306-7c31-4fa1-b9d3-3aec7a57f7d2/extract/0.log" Jul 08 12:41:44.809427 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:44.809396 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc_49de7306-7c31-4fa1-b9d3-3aec7a57f7d2/util/0.log" Jul 08 12:41:44.833878 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:44.833841 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592kvnc_49de7306-7c31-4fa1-b9d3-3aec7a57f7d2/pull/0.log" Jul 08 12:41:44.868173 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:44.868131 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl_efa39d73-ef69-4b84-b40c-7b51aa7dae46/extract/0.log" Jul 08 12:41:44.895235 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:44.895198 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl_efa39d73-ef69-4b84-b40c-7b51aa7dae46/util/0.log" Jul 08 12:41:44.922739 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:44.922702 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02x9sl_efa39d73-ef69-4b84-b40c-7b51aa7dae46/pull/0.log" Jul 08 12:41:44.955063 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:44.955018 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn_ae6e7c25-d0f2-4a43-83d8-367eac7928c4/extract/0.log" Jul 08 12:41:44.978712 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:44.978685 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn_ae6e7c25-d0f2-4a43-83d8-367eac7928c4/util/0.log" Jul 08 12:41:45.003666 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:45.003640 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vvpvn_ae6e7c25-d0f2-4a43-83d8-367eac7928c4/pull/0.log" Jul 08 12:41:45.032854 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:45.032750 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb_f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a/extract/0.log" Jul 08 12:41:45.055892 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:45.055866 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb_f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a/util/0.log" Jul 08 12:41:45.081951 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:45.081866 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mfnjb_f236bef4-4363-4e1e-b3fd-7f5d8fe23b9a/pull/0.log" Jul 08 12:41:45.450281 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:45.450188 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6dbfc7956c-hzhch_27b7c4f8-c08d-44b8-9c65-45a7dd11762e/authorino/0.log" Jul 08 12:41:47.788291 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:47.788217 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-4rgw2_de054497-a501-48d6-9337-823f98895573/cluster-monitoring-operator/0.log" Jul 08 12:41:47.827840 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:47.827725 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-ndltt_9d50282a-d27a-4349-b2e0-919b803a1df8/kube-state-metrics/0.log" Jul 08 12:41:47.851539 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:47.851511 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-ndltt_9d50282a-d27a-4349-b2e0-919b803a1df8/kube-rbac-proxy-main/0.log" Jul 08 12:41:47.878404 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:47.878375 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-ndltt_9d50282a-d27a-4349-b2e0-919b803a1df8/kube-rbac-proxy-self/0.log" Jul 08 12:41:47.910946 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:47.910900 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-78d858979-wrqzz_5fcfd64b-c504-4e26-9221-23ceb7c65a5a/metrics-server/0.log" Jul 08 12:41:47.975671 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:47.975640 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-48skh_1637c5f8-5a50-41de-8f84-f0d05ad5f4bc/node-exporter/0.log" Jul 08 12:41:47.999316 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:47.999289 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-48skh_1637c5f8-5a50-41de-8f84-f0d05ad5f4bc/kube-rbac-proxy/0.log" Jul 08 12:41:48.022755 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:48.022723 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-48skh_1637c5f8-5a50-41de-8f84-f0d05ad5f4bc/init-textfile/0.log" Jul 08 12:41:48.236383 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:48.236297 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-247m6_337f924e-e46b-4065-99de-6182b2430841/kube-rbac-proxy-main/0.log" Jul 08 12:41:48.261988 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:48.261959 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-247m6_337f924e-e46b-4065-99de-6182b2430841/kube-rbac-proxy-self/0.log" Jul 08 12:41:48.296812 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:48.296778 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-247m6_337f924e-e46b-4065-99de-6182b2430841/openshift-state-metrics/0.log" Jul 08 12:41:48.670800 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:48.670767 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-fx86r_f132a561-f51c-4df7-9f1f-38e5fb2ce7de/prometheus-operator-admission-webhook/0.log" Jul 08 12:41:48.706528 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:48.706480 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54f7b898c9-jdsg4_e4bde902-e7fb-4287-840f-b96bee18640f/telemeter-client/0.log" Jul 08 12:41:48.732178 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:48.732130 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54f7b898c9-jdsg4_e4bde902-e7fb-4287-840f-b96bee18640f/reload/0.log" Jul 08 12:41:48.758018 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:48.757991 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54f7b898c9-jdsg4_e4bde902-e7fb-4287-840f-b96bee18640f/kube-rbac-proxy/0.log" Jul 08 12:41:48.796518 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:48.796480 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866d7745cc-5n4vf_0e9ad891-b318-43af-b261-7ac068d135e2/thanos-query/0.log" Jul 08 12:41:48.820504 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:48.820470 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866d7745cc-5n4vf_0e9ad891-b318-43af-b261-7ac068d135e2/kube-rbac-proxy-web/0.log" Jul 08 12:41:48.844343 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:48.844315 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866d7745cc-5n4vf_0e9ad891-b318-43af-b261-7ac068d135e2/kube-rbac-proxy/0.log" Jul 08 12:41:48.867625 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:48.867592 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866d7745cc-5n4vf_0e9ad891-b318-43af-b261-7ac068d135e2/prom-label-proxy/0.log" Jul 08 12:41:48.893965 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:48.893934 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866d7745cc-5n4vf_0e9ad891-b318-43af-b261-7ac068d135e2/kube-rbac-proxy-rules/0.log" Jul 08 12:41:48.918191 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:48.918162 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866d7745cc-5n4vf_0e9ad891-b318-43af-b261-7ac068d135e2/kube-rbac-proxy-metrics/0.log" Jul 08 12:41:50.084050 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.084012 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-7lld4_ee7138e9-50b0-4552-a2a0-1ac74d70b886/networking-console-plugin/0.log" Jul 08 12:41:50.298606 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.298569 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2"] Jul 08 12:41:50.304256 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.304227 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:50.313167 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.313140 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2"] Jul 08 12:41:50.457026 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.456933 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bb3aee1d-d972-49b3-92cd-b5891fff28b8-proc\") pod \"perf-node-gather-daemonset-xv5t2\" (UID: \"bb3aee1d-d972-49b3-92cd-b5891fff28b8\") " pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:50.457306 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.457286 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75n78\" (UniqueName: \"kubernetes.io/projected/bb3aee1d-d972-49b3-92cd-b5891fff28b8-kube-api-access-75n78\") pod \"perf-node-gather-daemonset-xv5t2\" (UID: \"bb3aee1d-d972-49b3-92cd-b5891fff28b8\") " pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:50.457453 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.457440 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb3aee1d-d972-49b3-92cd-b5891fff28b8-sys\") pod \"perf-node-gather-daemonset-xv5t2\" (UID: \"bb3aee1d-d972-49b3-92cd-b5891fff28b8\") " pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:50.457555 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.457542 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb3aee1d-d972-49b3-92cd-b5891fff28b8-lib-modules\") pod \"perf-node-gather-daemonset-xv5t2\" (UID: \"bb3aee1d-d972-49b3-92cd-b5891fff28b8\") " pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:50.457737 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.457723 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bb3aee1d-d972-49b3-92cd-b5891fff28b8-podres\") pod \"perf-node-gather-daemonset-xv5t2\" (UID: \"bb3aee1d-d972-49b3-92cd-b5891fff28b8\") " pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:50.558996 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.558958 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bb3aee1d-d972-49b3-92cd-b5891fff28b8-podres\") pod \"perf-node-gather-daemonset-xv5t2\" (UID: \"bb3aee1d-d972-49b3-92cd-b5891fff28b8\") " pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:50.558996 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.559002 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bb3aee1d-d972-49b3-92cd-b5891fff28b8-proc\") pod \"perf-node-gather-daemonset-xv5t2\" (UID: \"bb3aee1d-d972-49b3-92cd-b5891fff28b8\") " pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:50.559363 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.559052 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75n78\" (UniqueName: \"kubernetes.io/projected/bb3aee1d-d972-49b3-92cd-b5891fff28b8-kube-api-access-75n78\") pod \"perf-node-gather-daemonset-xv5t2\" (UID: \"bb3aee1d-d972-49b3-92cd-b5891fff28b8\") " pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:50.559363 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.559112 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb3aee1d-d972-49b3-92cd-b5891fff28b8-sys\") pod \"perf-node-gather-daemonset-xv5t2\" (UID: \"bb3aee1d-d972-49b3-92cd-b5891fff28b8\") " pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:50.559363 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.559146 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb3aee1d-d972-49b3-92cd-b5891fff28b8-lib-modules\") pod \"perf-node-gather-daemonset-xv5t2\" (UID: \"bb3aee1d-d972-49b3-92cd-b5891fff28b8\") " pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:50.559363 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.559166 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bb3aee1d-d972-49b3-92cd-b5891fff28b8-podres\") pod \"perf-node-gather-daemonset-xv5t2\" (UID: \"bb3aee1d-d972-49b3-92cd-b5891fff28b8\") " pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:50.559363 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.559308 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb3aee1d-d972-49b3-92cd-b5891fff28b8-sys\") pod \"perf-node-gather-daemonset-xv5t2\" (UID: \"bb3aee1d-d972-49b3-92cd-b5891fff28b8\") " pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:50.559663 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.559432 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb3aee1d-d972-49b3-92cd-b5891fff28b8-lib-modules\") pod \"perf-node-gather-daemonset-xv5t2\" (UID: \"bb3aee1d-d972-49b3-92cd-b5891fff28b8\") " pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:50.559663 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.559486 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bb3aee1d-d972-49b3-92cd-b5891fff28b8-proc\") pod \"perf-node-gather-daemonset-xv5t2\" (UID: \"bb3aee1d-d972-49b3-92cd-b5891fff28b8\") " pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:50.568515 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.568476 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75n78\" (UniqueName: \"kubernetes.io/projected/bb3aee1d-d972-49b3-92cd-b5891fff28b8-kube-api-access-75n78\") pod \"perf-node-gather-daemonset-xv5t2\" (UID: \"bb3aee1d-d972-49b3-92cd-b5891fff28b8\") " pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:50.617434 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.617394 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:50.672288 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.672257 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/2.log" Jul 08 12:41:50.675967 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.675941 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-jxw77_b25b26e6-a5e0-46b1-bb84-ea8cf1b193dd/console-operator/3.log" Jul 08 12:41:50.795958 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:50.795905 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2"] Jul 08 12:41:51.363705 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:51.363620 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" event={"ID":"bb3aee1d-d972-49b3-92cd-b5891fff28b8","Type":"ContainerStarted","Data":"1243c7ada8d2339dbd49eacc60b26aa2fe753c56e27e3db0f9729923ba773784"} Jul 08 12:41:51.363705 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:51.363681 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" event={"ID":"bb3aee1d-d972-49b3-92cd-b5891fff28b8","Type":"ContainerStarted","Data":"d0cfca1fa7b6578544a054287e695e54aa0bb9eb93c5285bee476c85a8f23ef2"} Jul 08 12:41:51.364241 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:51.363714 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:51.383222 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:51.383160 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" podStartSLOduration=1.383138473 podStartE2EDuration="1.383138473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 12:41:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 12:41:51.381436 +0000 UTC m=+2422.741175322" watchObservedRunningTime="2026-07-08 12:41:51.383138473 +0000 UTC m=+2422.742877783" Jul 08 12:41:52.959652 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:52.959627 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vcls6_785fe3cf-57e7-4673-b7a8-8e40ec6d68bf/dns/0.log" Jul 08 12:41:52.983335 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:52.983310 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vcls6_785fe3cf-57e7-4673-b7a8-8e40ec6d68bf/kube-rbac-proxy/0.log" Jul 08 12:41:53.039061 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:53.039032 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v8bfs_b0da5445-6313-44dc-b5e2-602b2eac0a0f/dns-node-resolver/0.log" Jul 08 12:41:53.698217 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:53.698189 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sfqvq_e398d007-962f-4661-ad5d-74798f925e45/node-ca/0.log" Jul 08 12:41:54.699264 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:54.699232 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mpnj4_48751fbb-ce21-4b1b-a741-b0129b72b287/istio-proxy/0.log" Jul 08 12:41:54.861797 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:54.861769 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-765c5b48c6-vtbsx_3dd3cf00-05d6-495f-ba49-be9111a615f1/kube-auth-proxy/0.log" Jul 08 12:41:55.737393 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:55.737364 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kt79l_f4e9612f-d4c4-423f-904a-bd1afb95fa88/serve-healthcheck-canary/0.log" Jul 08 12:41:56.494743 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:56.494715 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fh2b6_c6c06582-b8ae-43a6-81b4-7366d2012e58/kube-rbac-proxy/0.log" Jul 08 12:41:56.520513 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:56.520479 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fh2b6_c6c06582-b8ae-43a6-81b4-7366d2012e58/exporter/0.log" Jul 08 12:41:56.545174 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:56.545145 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fh2b6_c6c06582-b8ae-43a6-81b4-7366d2012e58/extractor/0.log" Jul 08 12:41:57.382449 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:57.382424 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-drpcz/perf-node-gather-daemonset-xv5t2" Jul 08 12:41:58.963950 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:58.963924 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-f25kr_0f10b1bb-58b6-4a02-ab16-d75f3e4551ad/server/0.log" Jul 08 12:41:59.035729 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:59.035688 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-694hd_4ec4bbe5-522e-4caf-8005-6fdcd5601001/manager/0.log" Jul 08 12:41:59.123869 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:59.123789 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6db55b68b6-85fkl_7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9/manager/0.log" Jul 08 12:41:59.143532 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:41:59.143494 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6db55b68b6-85fkl_7bdc0b3c-e4ba-4e3e-802f-8bea3cf1b2b9/copy-manifests/0.log" Jul 08 12:42:00.604820 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:42:00.604758 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mpnj4_48751fbb-ce21-4b1b-a741-b0129b72b287/istio-proxy/0.log" Jul 08 12:42:00.684479 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:42:00.684443 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c77454567-nknh7_be530a2b-62b9-41fb-8b65-d0089830df5d/manager/0.log" Jul 08 12:42:00.729506 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:42:00.729480 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-765c5b48c6-vtbsx_3dd3cf00-05d6-495f-ba49-be9111a615f1/kube-auth-proxy/0.log" Jul 08 12:42:02.074367 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:42:02.074332 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mpnj4_48751fbb-ce21-4b1b-a741-b0129b72b287/istio-proxy/0.log" Jul 08 12:42:02.207818 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:42:02.207746 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-765c5b48c6-vtbsx_3dd3cf00-05d6-495f-ba49-be9111a615f1/kube-auth-proxy/0.log" Jul 08 12:42:07.440109 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:42:07.440029 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4pg4j_6343bd03-9ff5-42a1-b34c-7492789d08fa/kube-multus-additional-cni-plugins/0.log" Jul 08 12:42:07.478028 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:42:07.477997 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4pg4j_6343bd03-9ff5-42a1-b34c-7492789d08fa/egress-router-binary-copy/0.log" Jul 08 12:42:07.505788 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:42:07.505748 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4pg4j_6343bd03-9ff5-42a1-b34c-7492789d08fa/cni-plugins/0.log" Jul 08 12:42:07.532466 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:42:07.532438 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4pg4j_6343bd03-9ff5-42a1-b34c-7492789d08fa/bond-cni-plugin/0.log" Jul 08 12:42:07.558490 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:42:07.558463 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4pg4j_6343bd03-9ff5-42a1-b34c-7492789d08fa/routeoverride-cni/0.log" Jul 08 12:42:07.584740 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:42:07.584714 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4pg4j_6343bd03-9ff5-42a1-b34c-7492789d08fa/whereabouts-cni-bincopy/0.log" Jul 08 12:42:07.610095 ip-10-0-137-232 kubenswrapper[2560]: I0708 12:42:07.610071 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4pg4j_6343bd03-9ff5-42a1-b34c-7492789d08fa/whereabouts-cni/0.log"