Jul 06 14:17:57.398160 ip-10-0-136-208 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 14:17:57.398175 ip-10-0-136-208 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 14:17:57.398193 ip-10-0-136-208 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 14:17:57.398709 ip-10-0-136-208 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 14:18:07.492951 ip-10-0-136-208 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 14:18:07.492975 ip-10-0-136-208 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a3e8a55816ca461fa70cc943c36daf50 -- Jul 06 14:19:38.417943 ip-10-0-136-208 systemd[1]: Starting Kubernetes Kubelet... Jul 06 14:19:38.988423 ip-10-0-136-208 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 14:19:38.988423 ip-10-0-136-208 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 14:19:38.988423 ip-10-0-136-208 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 14:19:38.988423 ip-10-0-136-208 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 14:19:38.988423 ip-10-0-136-208 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 14:19:38.991252 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.991141 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 14:19:38.996167 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996151 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 14:19:38.996167 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996167 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 14:19:38.996167 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996170 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996189 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996195 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996201 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996205 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996208 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996210 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996213 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996215 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996218 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996220 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996223 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996226 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996228 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996231 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996233 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996235 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996238 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996240 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996243 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 14:19:38.996265 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996245 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996247 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996250 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996252 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996255 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996257 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996260 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996262 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996264 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996267 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996270 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996272 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996275 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996277 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996280 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996285 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996289 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996291 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996295 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996297 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 14:19:38.996753 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996300 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996303 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996306 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996308 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996311 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996315 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996318 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996321 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996323 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996326 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996328 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996331 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996333 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996336 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996339 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996341 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996344 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996347 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996349 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 14:19:38.997399 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996352 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996354 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996357 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996360 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996362 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996365 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996368 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996370 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996373 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996375 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996377 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996380 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996382 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996385 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996387 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996389 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996392 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996394 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996398 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996400 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 14:19:38.997893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996402 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996405 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996407 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996410 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996412 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996416 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996420 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996423 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996426 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996428 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996431 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996434 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996437 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996439 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996442 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996444 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996447 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.996450 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997229 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 14:19:38.998357 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997236 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997240 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997243 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997246 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997249 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997252 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997255 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997257 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997260 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997263 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997265 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997268 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997270 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997272 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997275 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997277 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997280 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997282 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997285 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997287 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 14:19:38.998854 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997290 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997293 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997295 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997298 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997300 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997303 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997306 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997309 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997311 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997314 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997324 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997327 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997329 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997332 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997334 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997337 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997339 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997342 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997344 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997347 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 14:19:38.999355 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997349 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997352 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997354 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997357 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997359 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997362 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997364 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997367 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997370 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997372 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997375 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997379 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997382 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997390 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997393 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997396 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997398 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997401 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997403 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997406 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 14:19:38.999832 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997409 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997411 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997416 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997419 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997422 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997425 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997428 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997430 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997433 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997435 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997438 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997440 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997443 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997445 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997447 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997450 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997452 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997454 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997457 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 14:19:39.000308 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997459 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997462 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997465 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997468 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997471 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997474 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997476 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997479 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997483 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997486 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997488 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997490 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997493 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997495 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997498 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997500 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997503 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997506 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997508 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 14:19:39.000776 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997930 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997936 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997939 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997941 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997944 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997946 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997949 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997951 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997953 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997956 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997958 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997961 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997964 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997966 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997969 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997971 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997974 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997977 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997979 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997982 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 14:19:39.001223 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997985 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997988 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997990 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997993 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997995 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.997998 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998000 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998003 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998005 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998007 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998010 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998013 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998015 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998018 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998021 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998023 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998025 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998028 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998030 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998032 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 14:19:39.001708 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998035 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998038 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998040 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998042 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998045 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998048 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998050 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998053 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998055 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998058 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998060 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998063 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998065 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998068 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998070 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998072 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998075 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998077 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998079 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998082 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 14:19:39.002185 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998085 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998088 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998090 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998093 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998095 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998098 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998100 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998103 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998105 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998108 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998110 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998113 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998115 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998117 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998120 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998122 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998124 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998128 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998132 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 14:19:39.002783 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998135 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998138 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998141 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998143 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998146 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998149 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998152 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998154 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998156 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998159 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998161 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998164 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998166 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998169 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998172 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998175 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998179 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998183 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998185 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 06 14:19:39.003232 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998188 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998263 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998278 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998287 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998294 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998299 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998302 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998306 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998310 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998313 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998316 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998320 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998323 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998326 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998329 2582 flags.go:64] FLAG: --cgroup-root="" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998332 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998335 2582 flags.go:64] FLAG: --client-ca-file="" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998339 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998342 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998346 2582 flags.go:64] FLAG: --cluster-domain="" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998349 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998352 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998355 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998358 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 14:19:39.003683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998362 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998365 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998368 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998371 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998374 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998377 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998380 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998384 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998387 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998391 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998394 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998397 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998400 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998403 2582 flags.go:64] FLAG: --enable-server="true" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998406 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998410 2582 flags.go:64] FLAG: --event-burst="100" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998413 2582 flags.go:64] FLAG: --event-qps="50" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998416 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998419 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998421 2582 flags.go:64] FLAG: --eviction-hard="" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998425 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998428 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998431 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998434 2582 flags.go:64] FLAG: --eviction-soft="" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998437 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 14:19:39.004248 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998439 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998442 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998445 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998448 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998451 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998453 2582 flags.go:64] FLAG: --feature-gates="" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998457 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998460 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998462 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998465 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998468 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998471 2582 flags.go:64] FLAG: --help="false" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998474 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-136-208.ec2.internal" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998477 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998480 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998487 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998490 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998494 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998496 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998499 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998502 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998505 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998508 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998510 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 14:19:39.004893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998513 2582 flags.go:64] FLAG: --kube-reserved="" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998516 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998518 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998521 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998524 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998527 2582 flags.go:64] FLAG: --lock-file="" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998529 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998532 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998535 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998540 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998543 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998546 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998548 2582 flags.go:64] FLAG: --logging-format="text" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998551 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998554 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998557 2582 flags.go:64] FLAG: --manifest-url="" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998559 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998563 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998566 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998570 2582 flags.go:64] FLAG: --max-pods="110" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998573 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998576 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998578 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998582 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998586 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 14:19:39.005457 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998588 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998591 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998613 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998616 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998619 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998622 2582 flags.go:64] FLAG: --pod-cidr="" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998624 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998630 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998633 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998636 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998639 2582 flags.go:64] FLAG: --port="10250" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998642 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998645 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07ea5b6db273e81d5" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998648 2582 flags.go:64] FLAG: --qos-reserved="" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998651 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998654 2582 flags.go:64] FLAG: --register-node="true" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998657 2582 flags.go:64] FLAG: --register-with-taints="" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998660 2582 flags.go:64] FLAG: --registry-burst="10" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998663 2582 flags.go:64] FLAG: --registry-qps="5" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998665 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998668 2582 flags.go:64] FLAG: --reserved-memory="" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998671 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998674 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998678 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998680 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 14:19:39.006097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998683 2582 flags.go:64] FLAG: --runonce="false" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998686 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998689 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998692 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998695 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998697 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998701 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998705 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998708 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998711 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998714 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998716 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998719 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998722 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998725 2582 flags.go:64] FLAG: --system-cgroups="" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998727 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998732 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998735 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998738 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998743 2582 flags.go:64] FLAG: --tls-min-version="" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998746 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998749 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998752 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998754 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998757 2582 flags.go:64] FLAG: --v="2" Jul 06 14:19:39.006696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998761 2582 flags.go:64] FLAG: --version="false" Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998765 2582 flags.go:64] FLAG: --vmodule="" Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998769 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.998772 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998887 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998891 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998895 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998898 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998901 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998904 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998906 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998909 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998912 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998917 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998920 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998924 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998927 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998929 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998932 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998934 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 14:19:39.007451 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998937 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998939 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998942 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998944 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998947 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998949 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998953 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998956 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998960 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998963 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998966 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998969 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998972 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998975 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998978 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998981 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998984 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998987 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998990 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 14:19:39.008192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998993 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998995 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.998998 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999001 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999003 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999006 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999009 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999011 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999014 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999017 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999019 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999022 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999024 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999027 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999029 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999032 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999034 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999036 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999039 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999042 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 14:19:39.008747 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999045 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999047 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999050 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999052 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999054 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999057 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999059 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999062 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999064 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999066 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999069 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999071 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999074 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999076 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999078 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999081 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999083 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999086 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999089 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999092 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 14:19:39.009220 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999094 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999097 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999100 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999102 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999105 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999107 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999110 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999112 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999115 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999117 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999119 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999123 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999125 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999128 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999130 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999132 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999135 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999137 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999140 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999142 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 14:19:39.009714 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999144 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 14:19:39.010191 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999147 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 14:19:39.010191 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999149 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 14:19:39.010191 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:38.999152 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 14:19:39.010191 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:38.999944 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 14:19:39.010191 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.009168 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 14:19:39.010191 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.009184 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 14:19:39.010191 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.009930 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 14:19:39.010191 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.009938 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 14:19:39.010191 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.009996 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 14:19:39.010191 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010002 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 14:19:39.010191 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010006 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 14:19:39.010191 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010009 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 14:19:39.010191 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010012 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 14:19:39.010191 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010014 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 14:19:39.010191 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010017 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010020 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010022 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010025 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010027 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010030 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010032 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010035 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010037 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010040 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010042 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010044 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010047 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010050 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010053 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010055 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010058 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010060 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010063 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010066 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 14:19:39.010546 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010068 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010070 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010073 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010076 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010079 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010081 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010084 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010086 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010089 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010092 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010094 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010097 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010100 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010102 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010104 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010107 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010109 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010112 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010114 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010117 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 14:19:39.011071 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010119 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010121 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010124 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010126 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010129 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010131 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010134 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010136 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010139 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010141 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010145 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010148 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010151 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010154 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010157 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010160 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010163 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010166 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010168 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010171 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 14:19:39.011533 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010173 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010176 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010178 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010180 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010183 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010185 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010188 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010190 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010193 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010196 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010198 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010201 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010204 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010207 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010210 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010212 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010214 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010217 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010220 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 06 14:19:39.012008 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010222 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 14:19:39.012450 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010225 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 14:19:39.012450 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010227 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 14:19:39.012450 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010230 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 14:19:39.012450 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010232 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 14:19:39.012450 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010234 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 14:19:39.012450 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010237 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 14:19:39.012450 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010241 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 14:19:39.012450 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010245 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 14:19:39.012450 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010248 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 14:19:39.012450 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010251 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 14:19:39.012450 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010254 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 14:19:39.012450 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010257 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 14:19:39.012450 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010260 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 14:19:39.012450 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.010265 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 14:19:39.012450 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010375 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010380 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010383 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010386 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010389 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010392 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010394 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010397 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010399 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010402 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010404 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010407 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010409 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010412 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010416 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010419 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010422 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010425 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010427 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010429 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 14:19:39.012836 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010432 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010434 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010437 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010439 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010442 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010444 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010447 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010449 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010452 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010454 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010457 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010460 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010462 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010465 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010467 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010469 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010472 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010474 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010476 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010479 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 14:19:39.013300 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010482 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010484 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010486 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010489 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010491 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010494 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010496 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010499 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010501 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010504 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010506 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010508 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010510 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010514 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010517 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010519 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010521 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010524 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010527 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010529 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 14:19:39.013941 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010532 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010534 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010537 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010539 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010542 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010544 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010547 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010549 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010552 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010554 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010557 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010559 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010562 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010564 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010566 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010569 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010571 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010574 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010577 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010579 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 14:19:39.014403 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010582 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 14:19:39.014878 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010584 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 14:19:39.014878 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010586 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 14:19:39.014878 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010589 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 14:19:39.014878 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010591 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 14:19:39.014878 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010593 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 14:19:39.014878 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010618 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 14:19:39.014878 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010622 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 14:19:39.014878 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010625 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 14:19:39.014878 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010628 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 14:19:39.014878 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010630 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 14:19:39.014878 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010633 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 14:19:39.014878 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010635 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 14:19:39.014878 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010638 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 14:19:39.014878 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010641 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 14:19:39.014878 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010643 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 14:19:39.014878 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010647 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 14:19:39.014878 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010650 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 14:19:39.014878 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:39.010653 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 14:19:39.015302 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.010658 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 14:19:39.015302 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.010783 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 14:19:39.015302 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.014874 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 14:19:39.016536 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.016525 2582 server.go:1019] "Starting client certificate rotation" Jul 06 14:19:39.016651 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.016634 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 14:19:39.016688 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.016674 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 14:19:39.019320 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.019308 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 14:19:39.021382 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.021363 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 14:19:39.034948 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.034930 2582 log.go:25] "Validated CRI v1 runtime API" Jul 06 14:19:39.039030 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.039014 2582 log.go:25] "Validated CRI v1 image API" Jul 06 14:19:39.040781 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.040763 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 14:19:39.043429 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.043410 2582 fs.go:135] Filesystem UUIDs: map[608bbcd5-3467-41d5-9fee-bbc9ef217dc4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 91d51d2a-5088-4e57-91c3-678d7285d458:/dev/nvme0n1p3] Jul 06 14:19:39.043497 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.043428 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 14:19:39.047543 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.047523 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 14:19:39.048884 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.048775 2582 manager.go:216] Machine: {Timestamp:2026-07-06 14:19:39.047368804 +0000 UTC m=+0.379609298 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3197305 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28ea84916cfaa851cd0a3e70abc7e6 SystemUUID:ec28ea84-916c-faa8-51cd-0a3e70abc7e6 BootID:a3e8a558-16ca-461f-a70c-c943c36daf50 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:81:d3:51:a5:73 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:81:d3:51:a5:73 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:db:cd:0b:07:23 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 14:19:39.048884 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.048877 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 14:19:39.049042 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.048989 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 14:19:39.053259 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.053084 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 14:19:39.053402 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.053264 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-208.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 14:19:39.054149 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.054138 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 14:19:39.054187 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.054152 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 14:19:39.054187 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.054160 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 14:19:39.054187 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.054174 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 14:19:39.056109 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.056100 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 14:19:39.060820 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.060809 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 06 14:19:39.060966 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.060956 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 14:19:39.060994 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.060987 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 06 14:19:39.061022 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.060997 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 14:19:39.061022 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.061011 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 14:19:39.061022 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.061020 2582 kubelet.go:398] "Adding apiserver pod source" Jul 06 14:19:39.061101 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.061035 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 14:19:39.062078 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.062063 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 14:19:39.062136 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.062090 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 14:19:39.064533 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.064515 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 14:19:39.066977 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.066965 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 14:19:39.067024 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.066994 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 14:19:39.068357 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.068346 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 14:19:39.068407 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.068362 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 14:19:39.068407 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.068368 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 14:19:39.068407 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.068374 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 14:19:39.068407 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.068382 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 14:19:39.068407 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.068387 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 14:19:39.068407 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.068395 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 14:19:39.068407 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.068400 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 14:19:39.068407 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.068407 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 14:19:39.068619 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.068412 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 14:19:39.068619 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.068420 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 14:19:39.068619 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.068425 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 14:19:39.069375 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.069366 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 14:19:39.069407 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.069377 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 14:19:39.070515 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.070495 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fvvjt" Jul 06 14:19:39.072462 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.072434 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-208.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 14:19:39.072540 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.072463 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-208.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 14:19:39.072540 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.072466 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 14:19:39.072644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.072633 2582 server.go:1268] "Started kubelet" Jul 06 14:19:39.072713 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.072687 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 14:19:39.072791 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.072712 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 14:19:39.072879 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.072825 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 14:19:39.073664 ip-10-0-136-208 systemd[1]: Started Kubernetes Kubelet. Jul 06 14:19:39.074244 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.073797 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 06 14:19:39.075195 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.075178 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 14:19:39.078780 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.077716 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-208.ec2.internal.18bfb92cb1acb0ee default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-208.ec2.internal,UID:ip-10-0-136-208.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-208.ec2.internal,},FirstTimestamp:2026-07-06 14:19:39.072590062 +0000 UTC m=+0.404830553,LastTimestamp:2026-07-06 14:19:39.072590062 +0000 UTC m=+0.404830553,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-208.ec2.internal,}" Jul 06 14:19:39.079826 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.079811 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fvvjt" Jul 06 14:19:39.080361 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.080343 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 14:19:39.083454 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.083437 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 14:19:39.083454 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.083450 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 14:19:39.083583 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.083557 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-208.ec2.internal\" not found" Jul 06 14:19:39.084200 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.084181 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 14:19:39.084287 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.084270 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 14:19:39.084352 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.084292 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 14:19:39.084393 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.084375 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 06 14:19:39.084393 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.084384 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 06 14:19:39.084628 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.084594 2582 factory.go:153] Registering CRI-O factory Jul 06 14:19:39.084682 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.084631 2582 factory.go:223] Registration of the crio container factory successfully Jul 06 14:19:39.084730 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.084684 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 14:19:39.084730 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.084693 2582 factory.go:55] Registering systemd factory Jul 06 14:19:39.084730 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.084701 2582 factory.go:223] Registration of the systemd container factory successfully Jul 06 14:19:39.084730 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.084720 2582 factory.go:103] Registering Raw factory Jul 06 14:19:39.084730 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.084733 2582 manager.go:1196] Started watching for new ooms in manager Jul 06 14:19:39.085777 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.085747 2582 manager.go:349] Starting recovery of all containers Jul 06 14:19:39.086039 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.086015 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 14:19:39.086137 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.086109 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-208.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 14:19:39.097231 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.097213 2582 manager.go:354] Recovery completed Jul 06 14:19:39.101032 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.101019 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:19:39.103095 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.103077 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:19:39.103177 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.103109 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:19:39.103177 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.103124 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:19:39.103721 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.103707 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 14:19:39.103759 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.103721 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 14:19:39.103759 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.103737 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 06 14:19:39.103759 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.103715 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:19:39.104346 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.104332 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:19:39.104394 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.104357 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:19:39.104394 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.104367 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:19:39.106069 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.106056 2582 policy_none.go:49] "None policy: Start" Jul 06 14:19:39.106137 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.106079 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 14:19:39.106137 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.106089 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 14:19:39.107989 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.107979 2582 policy_none.go:47] "Start" Jul 06 14:19:39.169847 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.147111 2582 manager.go:337] "Starting Device Plugin manager" Jul 06 14:19:39.169847 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.147377 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 14:19:39.169847 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.147389 2582 server.go:87] "Starting device plugin registration server" Jul 06 14:19:39.169847 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.148047 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 14:19:39.169847 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.148063 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 14:19:39.169847 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.148193 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 14:19:39.169847 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.148293 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 14:19:39.169847 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.148302 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 14:19:39.169847 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.148821 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 14:19:39.169847 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.148875 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-208.ec2.internal\" not found" Jul 06 14:19:39.169847 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.155903 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 14:19:39.169847 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.157234 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 14:19:39.169847 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.157268 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 14:19:39.169847 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.157296 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 14:19:39.169847 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.157327 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 14:19:39.169847 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.160000 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 14:19:39.248792 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.248657 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:19:39.249711 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.249691 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:19:39.249841 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.249723 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:19:39.249841 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.249732 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:19:39.249841 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.249755 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-208.ec2.internal" Jul 06 14:19:39.258223 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.258204 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-208.ec2.internal"] Jul 06 14:19:39.258272 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.258266 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:19:39.258495 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.258481 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-208.ec2.internal" Jul 06 14:19:39.258550 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.258502 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-208.ec2.internal\": node \"ip-10-0-136-208.ec2.internal\" not found" Jul 06 14:19:39.259084 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.259062 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:19:39.259188 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.259099 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:19:39.259188 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.259115 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:19:39.261410 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.261396 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:19:39.261522 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.261507 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal" Jul 06 14:19:39.261563 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.261540 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:19:39.262091 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.262077 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:19:39.262160 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.262098 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:19:39.262160 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.262106 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:19:39.262254 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.262172 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:19:39.262254 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.262200 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:19:39.262254 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.262214 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:19:39.264548 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.264525 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-208.ec2.internal" Jul 06 14:19:39.264675 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.264576 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:19:39.265299 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.265283 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:19:39.265369 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.265324 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:19:39.265369 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.265339 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:19:39.273502 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.273486 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-208.ec2.internal\" not found" Jul 06 14:19:39.286452 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.286430 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-208.ec2.internal\" not found" node="ip-10-0-136-208.ec2.internal" Jul 06 14:19:39.290837 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.290818 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-208.ec2.internal\" not found" node="ip-10-0-136-208.ec2.internal" Jul 06 14:19:39.373946 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.373910 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-208.ec2.internal\" not found" Jul 06 14:19:39.385425 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.385396 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/264ba3c50c01053e42939662b94d2402-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal\" (UID: \"264ba3c50c01053e42939662b94d2402\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal" Jul 06 14:19:39.385578 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.385437 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/264ba3c50c01053e42939662b94d2402-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal\" (UID: \"264ba3c50c01053e42939662b94d2402\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal" Jul 06 14:19:39.385578 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.385463 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b8c6cec3a193d1bdd174e8ced89210cc-config\") pod \"kube-apiserver-proxy-ip-10-0-136-208.ec2.internal\" (UID: \"b8c6cec3a193d1bdd174e8ced89210cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-208.ec2.internal" Jul 06 14:19:39.474673 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.474645 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-208.ec2.internal\" not found" Jul 06 14:19:39.486200 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.486177 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/264ba3c50c01053e42939662b94d2402-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal\" (UID: \"264ba3c50c01053e42939662b94d2402\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal" Jul 06 14:19:39.486264 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.486204 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/264ba3c50c01053e42939662b94d2402-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal\" (UID: \"264ba3c50c01053e42939662b94d2402\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal" Jul 06 14:19:39.486264 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.486221 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b8c6cec3a193d1bdd174e8ced89210cc-config\") pod \"kube-apiserver-proxy-ip-10-0-136-208.ec2.internal\" (UID: \"b8c6cec3a193d1bdd174e8ced89210cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-208.ec2.internal" Jul 06 14:19:39.486325 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.486261 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/264ba3c50c01053e42939662b94d2402-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal\" (UID: \"264ba3c50c01053e42939662b94d2402\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal" Jul 06 14:19:39.486325 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.486258 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b8c6cec3a193d1bdd174e8ced89210cc-config\") pod \"kube-apiserver-proxy-ip-10-0-136-208.ec2.internal\" (UID: \"b8c6cec3a193d1bdd174e8ced89210cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-208.ec2.internal" Jul 06 14:19:39.486325 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.486283 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/264ba3c50c01053e42939662b94d2402-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal\" (UID: \"264ba3c50c01053e42939662b94d2402\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal" Jul 06 14:19:39.575742 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.575655 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-208.ec2.internal\" not found" Jul 06 14:19:39.591206 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.591180 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal" Jul 06 14:19:39.595284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.595263 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-208.ec2.internal" Jul 06 14:19:39.676794 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.676759 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-208.ec2.internal\" not found" Jul 06 14:19:39.777321 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.777289 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-208.ec2.internal\" not found" Jul 06 14:19:39.877847 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.877761 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-208.ec2.internal\" not found" Jul 06 14:19:39.904474 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:39.904447 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 14:19:39.978390 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:39.978363 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-208.ec2.internal\" not found" Jul 06 14:19:40.015825 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:40.015806 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 14:19:40.016224 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:40.015973 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 14:19:40.016224 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:40.015970 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 14:19:40.078774 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:40.078742 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-208.ec2.internal\" not found" Jul 06 14:19:40.088176 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:40.088142 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 14:14:40 +0000 UTC" deadline="2028-02-24 20:41:37.174184192 +0000 UTC" Jul 06 14:19:40.088176 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:40.088171 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14358h21m57.086017686s" Jul 06 14:19:40.179016 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:40.178943 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-208.ec2.internal\" not found" Jul 06 14:19:40.230703 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:40.230661 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264ba3c50c01053e42939662b94d2402.slice/crio-3b408bb2c5aa203919ee0addb4ae0918efbe2572654d0abb95e0cbf89b26fff5 WatchSource:0}: Error finding container 3b408bb2c5aa203919ee0addb4ae0918efbe2572654d0abb95e0cbf89b26fff5: Status 404 returned error can't find the container with id 3b408bb2c5aa203919ee0addb4ae0918efbe2572654d0abb95e0cbf89b26fff5 Jul 06 14:19:40.231256 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:40.231235 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c6cec3a193d1bdd174e8ced89210cc.slice/crio-3f4099814edb3369d212c4069261d2631601e603d0ed1d62355722417600b8cb WatchSource:0}: Error finding container 3f4099814edb3369d212c4069261d2631601e603d0ed1d62355722417600b8cb: Status 404 returned error can't find the container with id 3f4099814edb3369d212c4069261d2631601e603d0ed1d62355722417600b8cb Jul 06 14:19:40.234889 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:40.234869 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 14:19:40.279947 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:40.279915 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-208.ec2.internal\" not found" Jul 06 14:19:40.377684 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:40.377653 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 14:19:40.380009 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:40.379987 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-208.ec2.internal\" not found" Jul 06 14:19:40.421105 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:40.421077 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 14:19:40.484449 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:40.484359 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal" Jul 06 14:19:40.496332 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:40.496308 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 14:19:40.497468 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:40.497455 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-208.ec2.internal" Jul 06 14:19:40.512753 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:40.512731 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 14:19:41.062450 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.062417 2582 apiserver.go:52] "Watching apiserver" Jul 06 14:19:41.072902 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.072873 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 14:19:41.074227 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.074196 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-4gp2l","kube-system/kube-apiserver-proxy-ip-10-0-136-208.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt","openshift-cluster-node-tuning-operator/tuned-lzn7h","openshift-dns/node-resolver-gkrh4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal","openshift-multus/multus-59t7r","openshift-image-registry/node-ca-wtlss","openshift-multus/multus-additional-cni-plugins-pwfs6","openshift-multus/network-metrics-daemon-bsgjj","openshift-network-diagnostics/network-check-target-2krbh","openshift-network-operator/iptables-alerter-f6vcn","openshift-ovn-kubernetes/ovnkube-node-tntzk","kube-system/global-pull-secret-syncer-78ldj"] Jul 06 14:19:41.077078 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.077052 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-59t7r" Jul 06 14:19:41.079928 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.079904 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 14:19:41.079928 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.079920 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9cg22\"" Jul 06 14:19:41.080149 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.079938 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 14:19:41.080149 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.080138 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 14:19:41.080256 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.080169 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 14:19:41.080256 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.080200 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.082450 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.082423 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:41.082556 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.082525 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 14:19:41.082823 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.082807 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jt2tj\"" Jul 06 14:19:41.082889 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.082847 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 14:19:41.084135 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.083688 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 14:19:41.084135 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.083699 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 14:19:41.084135 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.083921 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 14:19:41.084135 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.083984 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 14:19:41.084135 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.084106 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 14:19:41.085559 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.084903 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 14:19:41.088209 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.085817 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:41.088209 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.086810 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 14:19:41.088209 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.086839 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rznq7\"" Jul 06 14:19:41.088209 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.086885 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 14:19:41.088455 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.088267 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gkrh4" Jul 06 14:19:41.088510 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.088459 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 14:19:41.088967 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.088948 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rtkq9\"" Jul 06 14:19:41.089065 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.089001 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 14:19:41.090309 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.090274 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:41.090393 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:41.090350 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78ldj" podUID="5e1320b0-0f60-4ac3-9519-44b66306b3b1" Jul 06 14:19:41.091081 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.090560 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 14:19:41.091081 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.090762 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4z4hr\"" Jul 06 14:19:41.091081 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.090948 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 14:19:41.093388 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.092877 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:41.094634 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.094594 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.094815 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.094767 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-lib-modules\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:41.094962 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.094947 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-os-release\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:41.095068 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095051 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4gp2l" Jul 06 14:19:41.095183 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095165 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 14:19:41.095328 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.094726 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 14:19:41.095389 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095167 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-cni-netd\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.095389 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095378 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1acc289b-ad04-43f2-ab9c-b192286bbb75-sys-fs\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:41.095492 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095399 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d4x8g\"" Jul 06 14:19:41.095492 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095402 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-var-lib-kubelet\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:41.095492 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095427 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-hostroot\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:41.095492 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095451 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh982\" (UniqueName: \"kubernetes.io/projected/e9f34edd-d08d-4870-b853-3e6fd9680f92-kube-api-access-rh982\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:41.095492 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095473 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1acc289b-ad04-43f2-ab9c-b192286bbb75-etc-selinux\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:41.095492 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.094978 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 14:19:41.095790 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095496 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-modprobe-d\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:41.095790 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095518 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-host-var-lib-cni-bin\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:41.095790 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095540 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-host-run-multus-certs\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:41.095790 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095564 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-run-ovn\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.095790 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095586 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-log-socket\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.095790 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095627 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-multus-socket-dir-parent\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:41.095790 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095652 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-systemd-units\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.095790 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095675 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-run\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:41.095790 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095709 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7728d473-ed46-4f23-8b65-2766d339dbd6-tmp\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:41.095790 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095738 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-kubernetes\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:41.095790 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095776 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-var-lib-openvswitch\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.096185 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095801 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-cni-bin\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.096185 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095840 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1acc289b-ad04-43f2-ab9c-b192286bbb75-socket-dir\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:41.096185 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095874 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfjkz\" (UniqueName: \"kubernetes.io/projected/1acc289b-ad04-43f2-ab9c-b192286bbb75-kube-api-access-bfjkz\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:41.096185 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095909 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-tuned\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:41.096185 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095937 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9f34edd-d08d-4870-b853-3e6fd9680f92-multus-daemon-config\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:41.096185 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095963 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-etc-kubernetes\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:41.096185 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.095985 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eed3871e-c826-4955-a445-ff2f9dc62631-ovnkube-config\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.096185 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096020 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1acc289b-ad04-43f2-ab9c-b192286bbb75-device-dir\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:41.096185 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096040 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-host\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:41.096185 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096062 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-run-ovn-kubernetes\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.096185 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096093 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-sysctl-conf\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:41.096185 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096125 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-system-cni-dir\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:41.096185 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096158 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9f34edd-d08d-4870-b853-3e6fd9680f92-cni-binary-copy\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:41.096185 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096186 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-host-var-lib-cni-multus\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:41.096748 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096211 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-etc-openvswitch\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.096748 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096235 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-sysconfig\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:41.096748 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096255 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-cnibin\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:41.096748 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096278 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1acc289b-ad04-43f2-ab9c-b192286bbb75-registration-dir\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:41.096748 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096299 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-host-run-k8s-cni-cncf-io\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:41.096748 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096323 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-slash\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.096748 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096343 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-run-systemd\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.096748 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096365 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-systemd\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:41.096748 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096395 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-host-run-netns\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:41.096748 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096427 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68vqc\" (UniqueName: \"kubernetes.io/projected/eed3871e-c826-4955-a445-ff2f9dc62631-kube-api-access-68vqc\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.096748 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096456 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eed3871e-c826-4955-a445-ff2f9dc62631-env-overrides\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.096748 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096480 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-sysctl-d\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:41.096748 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096589 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-sys\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:41.096748 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096673 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-kubelet\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.097585 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096803 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-run-netns\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.097585 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096834 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eed3871e-c826-4955-a445-ff2f9dc62631-ovnkube-script-lib\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.097585 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096861 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpj82\" (UniqueName: \"kubernetes.io/projected/7728d473-ed46-4f23-8b65-2766d339dbd6-kube-api-access-kpj82\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:41.097585 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096884 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-multus-cni-dir\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:41.097585 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096906 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-host-var-lib-kubelet\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:41.097585 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096929 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1acc289b-ad04-43f2-ab9c-b192286bbb75-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:41.097585 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096951 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-multus-conf-dir\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:41.097585 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.096973 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-run-openvswitch\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.097585 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.097005 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-node-log\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.097585 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.097027 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eed3871e-c826-4955-a445-ff2f9dc62631-ovn-node-metrics-cert\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:41.097585 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.097453 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wtlss" Jul 06 14:19:41.098023 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.097795 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 14:19:41.098113 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.098089 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fttd5\"" Jul 06 14:19:41.098216 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.097797 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 14:19:41.099757 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.099737 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 14:19:41.100005 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.099987 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:41.100139 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:41.100051 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsgjj" podUID="a5c657bf-dc1b-41f9-b16d-7d4336abdd69" Jul 06 14:19:41.100139 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.100069 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zvkbn\"" Jul 06 14:19:41.100307 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.100286 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 14:19:41.101154 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.100978 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 14:19:41.102424 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:41.102324 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:19:41.102424 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:41.102387 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2krbh" podUID="e332c7f3-e91d-4c1d-b29f-1568b2853493" Jul 06 14:19:42.353893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.353854 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f6vcn" Jul 06 14:19:42.359517 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.359494 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 14:19:42.359723 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.359707 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2qlgb\"" Jul 06 14:19:42.360053 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.360036 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 14:19:42.360138 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.360070 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 14:19:42.370974 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.370952 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lzpvg" Jul 06 14:19:42.379450 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.379428 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lzpvg" Jul 06 14:19:42.416513 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.416446 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal" event={"ID":"264ba3c50c01053e42939662b94d2402","Type":"ContainerStarted","Data":"3b408bb2c5aa203919ee0addb4ae0918efbe2572654d0abb95e0cbf89b26fff5"} Jul 06 14:19:42.417991 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.417962 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-208.ec2.internal" event={"ID":"b8c6cec3a193d1bdd174e8ced89210cc","Type":"ContainerStarted","Data":"3f4099814edb3369d212c4069261d2631601e603d0ed1d62355722417600b8cb"} Jul 06 14:19:42.434720 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.434685 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 14:19:42.446874 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.446836 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-kubernetes\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.447016 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.446881 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-var-lib-openvswitch\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.447016 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.446909 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-cni-bin\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.447016 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.446935 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1acc289b-ad04-43f2-ab9c-b192286bbb75-socket-dir\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:42.447016 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.446960 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfjkz\" (UniqueName: \"kubernetes.io/projected/1acc289b-ad04-43f2-ab9c-b192286bbb75-kube-api-access-bfjkz\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:42.447016 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.446977 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-var-lib-openvswitch\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.447016 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.446982 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-tuned\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.447315 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447038 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f5a6228-018c-4abe-b695-0be2d969f75f-tmp-dir\") pod \"node-resolver-gkrh4\" (UID: \"2f5a6228-018c-4abe-b695-0be2d969f75f\") " pod="openshift-dns/node-resolver-gkrh4" Jul 06 14:19:42.447315 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447066 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e1320b0-0f60-4ac3-9519-44b66306b3b1-kubelet-config\") pod \"global-pull-secret-syncer-78ldj\" (UID: \"5e1320b0-0f60-4ac3-9519-44b66306b3b1\") " pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:42.447315 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447095 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9f34edd-d08d-4870-b853-3e6fd9680f92-multus-daemon-config\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.447315 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447111 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1acc289b-ad04-43f2-ab9c-b192286bbb75-socket-dir\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:42.447315 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447116 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-etc-kubernetes\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.447315 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.446979 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-kubernetes\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.447315 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447160 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-cni-bin\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.447315 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447185 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-etc-kubernetes\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.447315 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447202 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eed3871e-c826-4955-a445-ff2f9dc62631-ovnkube-config\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.447315 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447218 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1acc289b-ad04-43f2-ab9c-b192286bbb75-device-dir\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:42.447315 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447234 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-host\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.447315 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447250 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e1320b0-0f60-4ac3-9519-44b66306b3b1-dbus\") pod \"global-pull-secret-syncer-78ldj\" (UID: \"5e1320b0-0f60-4ac3-9519-44b66306b3b1\") " pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:42.447315 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447284 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-host\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.447315 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447295 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1acc289b-ad04-43f2-ab9c-b192286bbb75-device-dir\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:42.448010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447295 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 14:19:42.448010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447336 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b003ab99-dec8-40d2-b216-86af044f2a4c-system-cni-dir\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.448010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447368 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-run-ovn-kubernetes\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.448010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447392 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-sysctl-conf\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.448010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447416 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b003ab99-dec8-40d2-b216-86af044f2a4c-cnibin\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.448010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447438 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-system-cni-dir\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.448010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447449 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-run-ovn-kubernetes\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.448010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447461 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9f34edd-d08d-4870-b853-3e6fd9680f92-cni-binary-copy\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.448010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447541 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-sysctl-conf\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.448010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447578 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-host-var-lib-cni-multus\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.448010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447593 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-etc-openvswitch\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.448010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447611 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-sysconfig\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.448010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447631 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b003ab99-dec8-40d2-b216-86af044f2a4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.448010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447648 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l5wz\" (UniqueName: \"kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz\") pod \"network-check-target-2krbh\" (UID: \"e332c7f3-e91d-4c1d-b29f-1568b2853493\") " pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:19:42.448010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447663 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf-host-slash\") pod \"iptables-alerter-f6vcn\" (UID: \"a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf\") " pod="openshift-network-operator/iptables-alerter-f6vcn" Jul 06 14:19:42.448010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447689 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-cnibin\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.448010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447719 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1acc289b-ad04-43f2-ab9c-b192286bbb75-registration-dir\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:42.448479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447731 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9f34edd-d08d-4870-b853-3e6fd9680f92-multus-daemon-config\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.448479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447740 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f5a6228-018c-4abe-b695-0be2d969f75f-hosts-file\") pod \"node-resolver-gkrh4\" (UID: \"2f5a6228-018c-4abe-b695-0be2d969f75f\") " pod="openshift-dns/node-resolver-gkrh4" Jul 06 14:19:42.448479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447763 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret\") pod \"global-pull-secret-syncer-78ldj\" (UID: \"5e1320b0-0f60-4ac3-9519-44b66306b3b1\") " pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:42.448479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447782 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ee272d2-a9a5-4bda-b04a-c0833b785412-host\") pod \"node-ca-wtlss\" (UID: \"4ee272d2-a9a5-4bda-b04a-c0833b785412\") " pod="openshift-image-registry/node-ca-wtlss" Jul 06 14:19:42.448479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447801 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-host-run-k8s-cni-cncf-io\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.448479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447824 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-slash\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.448479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447842 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-run-systemd\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.448479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447844 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eed3871e-c826-4955-a445-ff2f9dc62631-ovnkube-config\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.448479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447861 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-systemd\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.448479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447864 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-system-cni-dir\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.448479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447903 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-host-run-netns\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.448479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447905 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9f34edd-d08d-4870-b853-3e6fd9680f92-cni-binary-copy\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.448479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447923 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-host-var-lib-cni-multus\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.448479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447925 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68vqc\" (UniqueName: \"kubernetes.io/projected/eed3871e-c826-4955-a445-ff2f9dc62631-kube-api-access-68vqc\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.448479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447941 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-cnibin\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.448479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447963 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2rj8\" (UniqueName: \"kubernetes.io/projected/a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf-kube-api-access-l2rj8\") pod \"iptables-alerter-f6vcn\" (UID: \"a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf\") " pod="openshift-network-operator/iptables-alerter-f6vcn" Jul 06 14:19:42.448479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447968 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-host-run-k8s-cni-cncf-io\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.448479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.447988 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs\") pod \"network-metrics-daemon-bsgjj\" (UID: \"a5c657bf-dc1b-41f9-b16d-7d4336abdd69\") " pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:42.448973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448011 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nc2d\" (UniqueName: \"kubernetes.io/projected/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-kube-api-access-2nc2d\") pod \"network-metrics-daemon-bsgjj\" (UID: \"a5c657bf-dc1b-41f9-b16d-7d4336abdd69\") " pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:42.448973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448035 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eed3871e-c826-4955-a445-ff2f9dc62631-env-overrides\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.448973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448057 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b003ab99-dec8-40d2-b216-86af044f2a4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.448973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448080 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b003ab99-dec8-40d2-b216-86af044f2a4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.448973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448085 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-etc-openvswitch\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.448973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448104 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b003ab99-dec8-40d2-b216-86af044f2a4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.448973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448131 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-sysconfig\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.448973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448134 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-sysctl-d\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.448973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448142 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-slash\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.448973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448163 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-sys\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.448973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448180 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-run-systemd\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.448973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448184 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-kubelet\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.448973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448206 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-run-netns\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.448973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448226 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-systemd\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.448973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448227 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eed3871e-c826-4955-a445-ff2f9dc62631-ovnkube-script-lib\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.448973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448239 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-sysctl-d\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.448973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448259 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpj82\" (UniqueName: \"kubernetes.io/projected/7728d473-ed46-4f23-8b65-2766d339dbd6-kube-api-access-kpj82\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.449644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448285 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2cnz\" (UniqueName: \"kubernetes.io/projected/b003ab99-dec8-40d2-b216-86af044f2a4c-kube-api-access-j2cnz\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.449644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448299 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1acc289b-ad04-43f2-ab9c-b192286bbb75-registration-dir\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:42.449644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448307 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-multus-cni-dir\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.449644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448347 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-kubelet\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.449644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448377 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-host-var-lib-kubelet\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.449644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448350 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-host-run-netns\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.449644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448720 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1acc289b-ad04-43f2-ab9c-b192286bbb75-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:42.449644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448744 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0cb4fe3b-b20c-4913-8bb3-743295030fa8-agent-certs\") pod \"konnectivity-agent-4gp2l\" (UID: \"0cb4fe3b-b20c-4913-8bb3-743295030fa8\") " pod="kube-system/konnectivity-agent-4gp2l" Jul 06 14:19:42.449644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448761 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eed3871e-c826-4955-a445-ff2f9dc62631-ovnkube-script-lib\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.449644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448766 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0cb4fe3b-b20c-4913-8bb3-743295030fa8-konnectivity-ca\") pod \"konnectivity-agent-4gp2l\" (UID: \"0cb4fe3b-b20c-4913-8bb3-743295030fa8\") " pod="kube-system/konnectivity-agent-4gp2l" Jul 06 14:19:42.449644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448799 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4ee272d2-a9a5-4bda-b04a-c0833b785412-serviceca\") pod \"node-ca-wtlss\" (UID: \"4ee272d2-a9a5-4bda-b04a-c0833b785412\") " pod="openshift-image-registry/node-ca-wtlss" Jul 06 14:19:42.449644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448814 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l42cz\" (UniqueName: \"kubernetes.io/projected/4ee272d2-a9a5-4bda-b04a-c0833b785412-kube-api-access-l42cz\") pod \"node-ca-wtlss\" (UID: \"4ee272d2-a9a5-4bda-b04a-c0833b785412\") " pod="openshift-image-registry/node-ca-wtlss" Jul 06 14:19:42.449644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448830 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-sys\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.449644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448867 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-multus-conf-dir\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.449644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448886 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-run-openvswitch\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.449644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448901 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-node-log\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.449644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448902 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1acc289b-ad04-43f2-ab9c-b192286bbb75-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:42.450391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448917 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eed3871e-c826-4955-a445-ff2f9dc62631-ovn-node-metrics-cert\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.450391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448961 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-host-var-lib-kubelet\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.450391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448974 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-run-netns\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.450391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.448991 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-multus-cni-dir\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.450391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449010 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-run-openvswitch\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.450391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449039 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.450391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449045 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-multus-conf-dir\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.450391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449073 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eed3871e-c826-4955-a445-ff2f9dc62631-env-overrides\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.450391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449079 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-lib-modules\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.450391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449123 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-node-log\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.450391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449128 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.450391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449158 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-os-release\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.450391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449190 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-cni-netd\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.450391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449219 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-os-release\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.450391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449234 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-lib-modules\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.450391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449258 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1acc289b-ad04-43f2-ab9c-b192286bbb75-sys-fs\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:42.450391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449274 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-host-cni-netd\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.450391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449313 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-var-lib-kubelet\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.451284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449340 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b003ab99-dec8-40d2-b216-86af044f2a4c-os-release\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.451284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449399 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-var-lib-kubelet\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.451284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449446 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1acc289b-ad04-43f2-ab9c-b192286bbb75-sys-fs\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:42.451284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449478 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf-iptables-alerter-script\") pod \"iptables-alerter-f6vcn\" (UID: \"a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf\") " pod="openshift-network-operator/iptables-alerter-f6vcn" Jul 06 14:19:42.451284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449519 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-hostroot\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.451284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449568 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh982\" (UniqueName: \"kubernetes.io/projected/e9f34edd-d08d-4870-b853-3e6fd9680f92-kube-api-access-rh982\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.451284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449600 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1acc289b-ad04-43f2-ab9c-b192286bbb75-etc-selinux\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:42.451284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449638 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-modprobe-d\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.451284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449662 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-host-var-lib-cni-bin\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.451284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449689 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-host-run-multus-certs\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.451284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449696 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-hostroot\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.451284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449731 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-run-ovn\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.451284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449756 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-log-socket\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.451284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449768 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1acc289b-ad04-43f2-ab9c-b192286bbb75-etc-selinux\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:42.451284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449779 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-multus-socket-dir-parent\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.451284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449803 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-systemd-units\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.451284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449836 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-modprobe-d\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.452077 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449857 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-run\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.452077 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449863 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-host-run-multus-certs\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.452077 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449883 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7728d473-ed46-4f23-8b65-2766d339dbd6-tmp\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.452077 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449905 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7728d473-ed46-4f23-8b65-2766d339dbd6-run\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.452077 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.449917 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldphh\" (UniqueName: \"kubernetes.io/projected/2f5a6228-018c-4abe-b695-0be2d969f75f-kube-api-access-ldphh\") pod \"node-resolver-gkrh4\" (UID: \"2f5a6228-018c-4abe-b695-0be2d969f75f\") " pod="openshift-dns/node-resolver-gkrh4" Jul 06 14:19:42.452077 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.450114 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-systemd-units\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.452077 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.450151 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-host-var-lib-cni-bin\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.452077 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.450183 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-run-ovn\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.452077 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.450197 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eed3871e-c826-4955-a445-ff2f9dc62631-log-socket\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.452077 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.450258 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9f34edd-d08d-4870-b853-3e6fd9680f92-multus-socket-dir-parent\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.452077 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.451852 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7728d473-ed46-4f23-8b65-2766d339dbd6-etc-tuned\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.452571 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.452125 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eed3871e-c826-4955-a445-ff2f9dc62631-ovn-node-metrics-cert\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.452571 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.452266 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7728d473-ed46-4f23-8b65-2766d339dbd6-tmp\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.457566 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.457526 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpj82\" (UniqueName: \"kubernetes.io/projected/7728d473-ed46-4f23-8b65-2766d339dbd6-kube-api-access-kpj82\") pod \"tuned-lzn7h\" (UID: \"7728d473-ed46-4f23-8b65-2766d339dbd6\") " pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.457803 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.457787 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68vqc\" (UniqueName: \"kubernetes.io/projected/eed3871e-c826-4955-a445-ff2f9dc62631-kube-api-access-68vqc\") pod \"ovnkube-node-tntzk\" (UID: \"eed3871e-c826-4955-a445-ff2f9dc62631\") " pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.457907 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.457887 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh982\" (UniqueName: \"kubernetes.io/projected/e9f34edd-d08d-4870-b853-3e6fd9680f92-kube-api-access-rh982\") pod \"multus-59t7r\" (UID: \"e9f34edd-d08d-4870-b853-3e6fd9680f92\") " pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.459624 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.459599 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfjkz\" (UniqueName: \"kubernetes.io/projected/1acc289b-ad04-43f2-ab9c-b192286bbb75-kube-api-access-bfjkz\") pod \"aws-ebs-csi-driver-node-w8vbt\" (UID: \"1acc289b-ad04-43f2-ab9c-b192286bbb75\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:42.551284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.550922 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b003ab99-dec8-40d2-b216-86af044f2a4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.551284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.550958 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l5wz\" (UniqueName: \"kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz\") pod \"network-check-target-2krbh\" (UID: \"e332c7f3-e91d-4c1d-b29f-1568b2853493\") " pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:19:42.551284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.550982 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf-host-slash\") pod \"iptables-alerter-f6vcn\" (UID: \"a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf\") " pod="openshift-network-operator/iptables-alerter-f6vcn" Jul 06 14:19:42.551284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551011 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f5a6228-018c-4abe-b695-0be2d969f75f-hosts-file\") pod \"node-resolver-gkrh4\" (UID: \"2f5a6228-018c-4abe-b695-0be2d969f75f\") " pod="openshift-dns/node-resolver-gkrh4" Jul 06 14:19:42.551284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551036 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret\") pod \"global-pull-secret-syncer-78ldj\" (UID: \"5e1320b0-0f60-4ac3-9519-44b66306b3b1\") " pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:42.551284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551088 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ee272d2-a9a5-4bda-b04a-c0833b785412-host\") pod \"node-ca-wtlss\" (UID: \"4ee272d2-a9a5-4bda-b04a-c0833b785412\") " pod="openshift-image-registry/node-ca-wtlss" Jul 06 14:19:42.551284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551115 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2rj8\" (UniqueName: \"kubernetes.io/projected/a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf-kube-api-access-l2rj8\") pod \"iptables-alerter-f6vcn\" (UID: \"a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf\") " pod="openshift-network-operator/iptables-alerter-f6vcn" Jul 06 14:19:42.551284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551136 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs\") pod \"network-metrics-daemon-bsgjj\" (UID: \"a5c657bf-dc1b-41f9-b16d-7d4336abdd69\") " pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:42.551284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551160 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nc2d\" (UniqueName: \"kubernetes.io/projected/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-kube-api-access-2nc2d\") pod \"network-metrics-daemon-bsgjj\" (UID: \"a5c657bf-dc1b-41f9-b16d-7d4336abdd69\") " pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:42.551284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551184 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b003ab99-dec8-40d2-b216-86af044f2a4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.551284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551209 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b003ab99-dec8-40d2-b216-86af044f2a4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.551284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551246 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b003ab99-dec8-40d2-b216-86af044f2a4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.551284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551270 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ee272d2-a9a5-4bda-b04a-c0833b785412-host\") pod \"node-ca-wtlss\" (UID: \"4ee272d2-a9a5-4bda-b04a-c0833b785412\") " pod="openshift-image-registry/node-ca-wtlss" Jul 06 14:19:42.551284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551281 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2cnz\" (UniqueName: \"kubernetes.io/projected/b003ab99-dec8-40d2-b216-86af044f2a4c-kube-api-access-j2cnz\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.552067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551324 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0cb4fe3b-b20c-4913-8bb3-743295030fa8-agent-certs\") pod \"konnectivity-agent-4gp2l\" (UID: \"0cb4fe3b-b20c-4913-8bb3-743295030fa8\") " pod="kube-system/konnectivity-agent-4gp2l" Jul 06 14:19:42.552067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551347 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0cb4fe3b-b20c-4913-8bb3-743295030fa8-konnectivity-ca\") pod \"konnectivity-agent-4gp2l\" (UID: \"0cb4fe3b-b20c-4913-8bb3-743295030fa8\") " pod="kube-system/konnectivity-agent-4gp2l" Jul 06 14:19:42.552067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551367 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4ee272d2-a9a5-4bda-b04a-c0833b785412-serviceca\") pod \"node-ca-wtlss\" (UID: \"4ee272d2-a9a5-4bda-b04a-c0833b785412\") " pod="openshift-image-registry/node-ca-wtlss" Jul 06 14:19:42.552067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551388 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l42cz\" (UniqueName: \"kubernetes.io/projected/4ee272d2-a9a5-4bda-b04a-c0833b785412-kube-api-access-l42cz\") pod \"node-ca-wtlss\" (UID: \"4ee272d2-a9a5-4bda-b04a-c0833b785412\") " pod="openshift-image-registry/node-ca-wtlss" Jul 06 14:19:42.552067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551422 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b003ab99-dec8-40d2-b216-86af044f2a4c-os-release\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.552067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551443 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf-iptables-alerter-script\") pod \"iptables-alerter-f6vcn\" (UID: \"a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf\") " pod="openshift-network-operator/iptables-alerter-f6vcn" Jul 06 14:19:42.552067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551479 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldphh\" (UniqueName: \"kubernetes.io/projected/2f5a6228-018c-4abe-b695-0be2d969f75f-kube-api-access-ldphh\") pod \"node-resolver-gkrh4\" (UID: \"2f5a6228-018c-4abe-b695-0be2d969f75f\") " pod="openshift-dns/node-resolver-gkrh4" Jul 06 14:19:42.552067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551509 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f5a6228-018c-4abe-b695-0be2d969f75f-tmp-dir\") pod \"node-resolver-gkrh4\" (UID: \"2f5a6228-018c-4abe-b695-0be2d969f75f\") " pod="openshift-dns/node-resolver-gkrh4" Jul 06 14:19:42.552067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551576 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e1320b0-0f60-4ac3-9519-44b66306b3b1-kubelet-config\") pod \"global-pull-secret-syncer-78ldj\" (UID: \"5e1320b0-0f60-4ac3-9519-44b66306b3b1\") " pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:42.552067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551596 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b003ab99-dec8-40d2-b216-86af044f2a4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.552067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551610 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e1320b0-0f60-4ac3-9519-44b66306b3b1-dbus\") pod \"global-pull-secret-syncer-78ldj\" (UID: \"5e1320b0-0f60-4ac3-9519-44b66306b3b1\") " pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:42.552067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551644 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b003ab99-dec8-40d2-b216-86af044f2a4c-system-cni-dir\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.552067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551672 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b003ab99-dec8-40d2-b216-86af044f2a4c-cnibin\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.552067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551675 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e1320b0-0f60-4ac3-9519-44b66306b3b1-dbus\") pod \"global-pull-secret-syncer-78ldj\" (UID: \"5e1320b0-0f60-4ac3-9519-44b66306b3b1\") " pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:42.552067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551751 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b003ab99-dec8-40d2-b216-86af044f2a4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.552067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551758 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf-host-slash\") pod \"iptables-alerter-f6vcn\" (UID: \"a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf\") " pod="openshift-network-operator/iptables-alerter-f6vcn" Jul 06 14:19:42.552067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551795 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f5a6228-018c-4abe-b695-0be2d969f75f-hosts-file\") pod \"node-resolver-gkrh4\" (UID: \"2f5a6228-018c-4abe-b695-0be2d969f75f\") " pod="openshift-dns/node-resolver-gkrh4" Jul 06 14:19:42.552798 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551853 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b003ab99-dec8-40d2-b216-86af044f2a4c-cnibin\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.552798 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.551949 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b003ab99-dec8-40d2-b216-86af044f2a4c-os-release\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.552798 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.552032 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e1320b0-0f60-4ac3-9519-44b66306b3b1-kubelet-config\") pod \"global-pull-secret-syncer-78ldj\" (UID: \"5e1320b0-0f60-4ac3-9519-44b66306b3b1\") " pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:42.552798 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.552079 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b003ab99-dec8-40d2-b216-86af044f2a4c-system-cni-dir\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.552798 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.552121 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4ee272d2-a9a5-4bda-b04a-c0833b785412-serviceca\") pod \"node-ca-wtlss\" (UID: \"4ee272d2-a9a5-4bda-b04a-c0833b785412\") " pod="openshift-image-registry/node-ca-wtlss" Jul 06 14:19:42.552798 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:42.552166 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:19:42.552798 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:42.552227 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs podName:a5c657bf-dc1b-41f9-b16d-7d4336abdd69 nodeName:}" failed. No retries permitted until 2026-07-06 14:19:43.052207154 +0000 UTC m=+3.135500431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs") pod "network-metrics-daemon-bsgjj" (UID: "a5c657bf-dc1b-41f9-b16d-7d4336abdd69") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:19:42.552798 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.552233 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f5a6228-018c-4abe-b695-0be2d969f75f-tmp-dir\") pod \"node-resolver-gkrh4\" (UID: \"2f5a6228-018c-4abe-b695-0be2d969f75f\") " pod="openshift-dns/node-resolver-gkrh4" Jul 06 14:19:42.552798 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.552295 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b003ab99-dec8-40d2-b216-86af044f2a4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.552798 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:42.552445 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:19:42.552798 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:42.552614 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret podName:5e1320b0-0f60-4ac3-9519-44b66306b3b1 nodeName:}" failed. No retries permitted until 2026-07-06 14:19:43.052596056 +0000 UTC m=+3.135889312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret") pod "global-pull-secret-syncer-78ldj" (UID: "5e1320b0-0f60-4ac3-9519-44b66306b3b1") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:19:42.552798 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.552654 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf-iptables-alerter-script\") pod \"iptables-alerter-f6vcn\" (UID: \"a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf\") " pod="openshift-network-operator/iptables-alerter-f6vcn" Jul 06 14:19:42.552798 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.552714 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0cb4fe3b-b20c-4913-8bb3-743295030fa8-konnectivity-ca\") pod \"konnectivity-agent-4gp2l\" (UID: \"0cb4fe3b-b20c-4913-8bb3-743295030fa8\") " pod="kube-system/konnectivity-agent-4gp2l" Jul 06 14:19:42.553428 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.552879 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b003ab99-dec8-40d2-b216-86af044f2a4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.555937 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.555911 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0cb4fe3b-b20c-4913-8bb3-743295030fa8-agent-certs\") pod \"konnectivity-agent-4gp2l\" (UID: \"0cb4fe3b-b20c-4913-8bb3-743295030fa8\") " pod="kube-system/konnectivity-agent-4gp2l" Jul 06 14:19:42.558951 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:42.558932 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:19:42.558951 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:42.558954 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:19:42.559094 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:42.558967 2582 projected.go:196] Error preparing data for projected volume kube-api-access-4l5wz for pod openshift-network-diagnostics/network-check-target-2krbh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:19:42.559094 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:42.559019 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz podName:e332c7f3-e91d-4c1d-b29f-1568b2853493 nodeName:}" failed. No retries permitted until 2026-07-06 14:19:43.059005289 +0000 UTC m=+3.142298556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4l5wz" (UniqueName: "kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz") pod "network-check-target-2krbh" (UID: "e332c7f3-e91d-4c1d-b29f-1568b2853493") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:19:42.561361 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.561337 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2cnz\" (UniqueName: \"kubernetes.io/projected/b003ab99-dec8-40d2-b216-86af044f2a4c-kube-api-access-j2cnz\") pod \"multus-additional-cni-plugins-pwfs6\" (UID: \"b003ab99-dec8-40d2-b216-86af044f2a4c\") " pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.561877 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.561820 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2rj8\" (UniqueName: \"kubernetes.io/projected/a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf-kube-api-access-l2rj8\") pod \"iptables-alerter-f6vcn\" (UID: \"a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf\") " pod="openshift-network-operator/iptables-alerter-f6vcn" Jul 06 14:19:42.561877 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.561820 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldphh\" (UniqueName: \"kubernetes.io/projected/2f5a6228-018c-4abe-b695-0be2d969f75f-kube-api-access-ldphh\") pod \"node-resolver-gkrh4\" (UID: \"2f5a6228-018c-4abe-b695-0be2d969f75f\") " pod="openshift-dns/node-resolver-gkrh4" Jul 06 14:19:42.562328 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.562293 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nc2d\" (UniqueName: \"kubernetes.io/projected/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-kube-api-access-2nc2d\") pod \"network-metrics-daemon-bsgjj\" (UID: \"a5c657bf-dc1b-41f9-b16d-7d4336abdd69\") " pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:42.563695 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.563674 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l42cz\" (UniqueName: \"kubernetes.io/projected/4ee272d2-a9a5-4bda-b04a-c0833b785412-kube-api-access-l42cz\") pod \"node-ca-wtlss\" (UID: \"4ee272d2-a9a5-4bda-b04a-c0833b785412\") " pod="openshift-image-registry/node-ca-wtlss" Jul 06 14:19:42.571393 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.571372 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 14:19:42.639867 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.639819 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-59t7r" Jul 06 14:19:42.649328 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.649302 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:19:42.659318 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.659294 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" Jul 06 14:19:42.665623 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.665597 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" Jul 06 14:19:42.673422 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.673397 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gkrh4" Jul 06 14:19:42.680162 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.680138 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pwfs6" Jul 06 14:19:42.687905 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.687886 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4gp2l" Jul 06 14:19:42.695529 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.695510 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wtlss" Jul 06 14:19:42.702442 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:42.702424 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f6vcn" Jul 06 14:19:43.054950 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:43.054872 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret\") pod \"global-pull-secret-syncer-78ldj\" (UID: \"5e1320b0-0f60-4ac3-9519-44b66306b3b1\") " pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:43.054950 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:43.054917 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs\") pod \"network-metrics-daemon-bsgjj\" (UID: \"a5c657bf-dc1b-41f9-b16d-7d4336abdd69\") " pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:43.055172 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:43.055025 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:19:43.055172 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:43.055032 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:19:43.055172 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:43.055085 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs podName:a5c657bf-dc1b-41f9-b16d-7d4336abdd69 nodeName:}" failed. No retries permitted until 2026-07-06 14:19:44.055071011 +0000 UTC m=+4.138364280 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs") pod "network-metrics-daemon-bsgjj" (UID: "a5c657bf-dc1b-41f9-b16d-7d4336abdd69") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:19:43.055172 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:43.055119 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret podName:5e1320b0-0f60-4ac3-9519-44b66306b3b1 nodeName:}" failed. No retries permitted until 2026-07-06 14:19:44.055102637 +0000 UTC m=+4.138395896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret") pod "global-pull-secret-syncer-78ldj" (UID: "5e1320b0-0f60-4ac3-9519-44b66306b3b1") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:19:43.156160 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:43.156122 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l5wz\" (UniqueName: \"kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz\") pod \"network-check-target-2krbh\" (UID: \"e332c7f3-e91d-4c1d-b29f-1568b2853493\") " pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:19:43.156318 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:43.156280 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:19:43.156318 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:43.156296 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:19:43.156318 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:43.156309 2582 projected.go:196] Error preparing data for projected volume kube-api-access-4l5wz for pod openshift-network-diagnostics/network-check-target-2krbh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:19:43.156480 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:43.156372 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz podName:e332c7f3-e91d-4c1d-b29f-1568b2853493 nodeName:}" failed. No retries permitted until 2026-07-06 14:19:44.156353709 +0000 UTC m=+4.239646962 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4l5wz" (UniqueName: "kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz") pod "network-check-target-2krbh" (UID: "e332c7f3-e91d-4c1d-b29f-1568b2853493") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:19:43.241078 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:43.241048 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 14:19:43.375457 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:43.375433 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f34edd_d08d_4870_b853_3e6fd9680f92.slice/crio-ece5974f18bc78f9c9138a5fdbcee85c5a70377acc2f920a901bd5ece99eef6b WatchSource:0}: Error finding container ece5974f18bc78f9c9138a5fdbcee85c5a70377acc2f920a901bd5ece99eef6b: Status 404 returned error can't find the container with id ece5974f18bc78f9c9138a5fdbcee85c5a70377acc2f920a901bd5ece99eef6b Jul 06 14:19:43.376817 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:43.376783 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee272d2_a9a5_4bda_b04a_c0833b785412.slice/crio-5a10e402ca628a55a9f796f3429d654defcaf7d398b9f8a289acf0de36d37e36 WatchSource:0}: Error finding container 5a10e402ca628a55a9f796f3429d654defcaf7d398b9f8a289acf0de36d37e36: Status 404 returned error can't find the container with id 5a10e402ca628a55a9f796f3429d654defcaf7d398b9f8a289acf0de36d37e36 Jul 06 14:19:43.380044 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:43.380020 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb4fe3b_b20c_4913_8bb3_743295030fa8.slice/crio-6998a86497c504aed1e5c6650c985ce3d948c35c0f0eb05c6f8edef452ce422a WatchSource:0}: Error finding container 6998a86497c504aed1e5c6650c985ce3d948c35c0f0eb05c6f8edef452ce422a: Status 404 returned error can't find the container with id 6998a86497c504aed1e5c6650c985ce3d948c35c0f0eb05c6f8edef452ce422a Jul 06 14:19:43.381449 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:43.381427 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeed3871e_c826_4955_a445_ff2f9dc62631.slice/crio-41aa363cafc1fb24e1931e915cd5b87c92cc24bb6967ba8746600b62fabd93d6 WatchSource:0}: Error finding container 41aa363cafc1fb24e1931e915cd5b87c92cc24bb6967ba8746600b62fabd93d6: Status 404 returned error can't find the container with id 41aa363cafc1fb24e1931e915cd5b87c92cc24bb6967ba8746600b62fabd93d6 Jul 06 14:19:43.382843 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:43.382780 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7728d473_ed46_4f23_8b65_2766d339dbd6.slice/crio-025e46b426cdb755c5d3ce3e3111677e7b59a3e0ca5f509901700c034aeb887f WatchSource:0}: Error finding container 025e46b426cdb755c5d3ce3e3111677e7b59a3e0ca5f509901700c034aeb887f: Status 404 returned error can't find the container with id 025e46b426cdb755c5d3ce3e3111677e7b59a3e0ca5f509901700c034aeb887f Jul 06 14:19:43.383183 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:43.383129 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 14:14:42 +0000 UTC" deadline="2028-02-03 02:17:03.636872164 +0000 UTC" Jul 06 14:19:43.383183 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:43.383182 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13835h57m20.253694783s" Jul 06 14:19:43.385283 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:43.384725 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1acc289b_ad04_43f2_ab9c_b192286bbb75.slice/crio-a3a4082b17729476d9ab11b7ee57a741362c9a56b61a1855e2eb2a058154cea2 WatchSource:0}: Error finding container a3a4082b17729476d9ab11b7ee57a741362c9a56b61a1855e2eb2a058154cea2: Status 404 returned error can't find the container with id a3a4082b17729476d9ab11b7ee57a741362c9a56b61a1855e2eb2a058154cea2 Jul 06 14:19:43.385283 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:43.384969 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e65a06_cc77_4a3e_9eb2_c3cd36da5caf.slice/crio-4dac021d042878e4d8c4cd1a509663a5a4c7fb7c767904611cb775c956e91687 WatchSource:0}: Error finding container 4dac021d042878e4d8c4cd1a509663a5a4c7fb7c767904611cb775c956e91687: Status 404 returned error can't find the container with id 4dac021d042878e4d8c4cd1a509663a5a4c7fb7c767904611cb775c956e91687 Jul 06 14:19:43.386380 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:43.386357 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f5a6228_018c_4abe_b695_0be2d969f75f.slice/crio-6deae8c932d9b0be2bcc3538551c79d49a23ab4e9ca89729994abcd764e02e92 WatchSource:0}: Error finding container 6deae8c932d9b0be2bcc3538551c79d49a23ab4e9ca89729994abcd764e02e92: Status 404 returned error can't find the container with id 6deae8c932d9b0be2bcc3538551c79d49a23ab4e9ca89729994abcd764e02e92 Jul 06 14:19:43.388992 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:19:43.388971 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb003ab99_dec8_40d2_b216_86af044f2a4c.slice/crio-95c8a86308a619ceb6483dc0ea72b9b16b06f5abd4bff5f9679ffbe3046ab028 WatchSource:0}: Error finding container 95c8a86308a619ceb6483dc0ea72b9b16b06f5abd4bff5f9679ffbe3046ab028: Status 404 returned error can't find the container with id 95c8a86308a619ceb6483dc0ea72b9b16b06f5abd4bff5f9679ffbe3046ab028 Jul 06 14:19:43.407031 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:43.407012 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:43.407154 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:43.407133 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78ldj" podUID="5e1320b0-0f60-4ac3-9519-44b66306b3b1" Jul 06 14:19:43.422217 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:43.422157 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gkrh4" event={"ID":"2f5a6228-018c-4abe-b695-0be2d969f75f","Type":"ContainerStarted","Data":"6deae8c932d9b0be2bcc3538551c79d49a23ab4e9ca89729994abcd764e02e92"} Jul 06 14:19:43.423561 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:43.423510 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f6vcn" event={"ID":"a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf","Type":"ContainerStarted","Data":"4dac021d042878e4d8c4cd1a509663a5a4c7fb7c767904611cb775c956e91687"} Jul 06 14:19:43.425352 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:43.425326 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" event={"ID":"7728d473-ed46-4f23-8b65-2766d339dbd6","Type":"ContainerStarted","Data":"025e46b426cdb755c5d3ce3e3111677e7b59a3e0ca5f509901700c034aeb887f"} Jul 06 14:19:43.426375 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:43.426355 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" event={"ID":"eed3871e-c826-4955-a445-ff2f9dc62631","Type":"ContainerStarted","Data":"41aa363cafc1fb24e1931e915cd5b87c92cc24bb6967ba8746600b62fabd93d6"} Jul 06 14:19:43.427385 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:43.427359 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4gp2l" event={"ID":"0cb4fe3b-b20c-4913-8bb3-743295030fa8","Type":"ContainerStarted","Data":"6998a86497c504aed1e5c6650c985ce3d948c35c0f0eb05c6f8edef452ce422a"} Jul 06 14:19:43.428288 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:43.428269 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" event={"ID":"1acc289b-ad04-43f2-ab9c-b192286bbb75","Type":"ContainerStarted","Data":"a3a4082b17729476d9ab11b7ee57a741362c9a56b61a1855e2eb2a058154cea2"} Jul 06 14:19:43.429304 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:43.429274 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wtlss" event={"ID":"4ee272d2-a9a5-4bda-b04a-c0833b785412","Type":"ContainerStarted","Data":"5a10e402ca628a55a9f796f3429d654defcaf7d398b9f8a289acf0de36d37e36"} Jul 06 14:19:43.430232 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:43.430213 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-59t7r" event={"ID":"e9f34edd-d08d-4870-b853-3e6fd9680f92","Type":"ContainerStarted","Data":"ece5974f18bc78f9c9138a5fdbcee85c5a70377acc2f920a901bd5ece99eef6b"} Jul 06 14:19:43.431216 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:43.431198 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwfs6" event={"ID":"b003ab99-dec8-40d2-b216-86af044f2a4c","Type":"ContainerStarted","Data":"95c8a86308a619ceb6483dc0ea72b9b16b06f5abd4bff5f9679ffbe3046ab028"} Jul 06 14:19:44.063731 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:44.062368 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret\") pod \"global-pull-secret-syncer-78ldj\" (UID: \"5e1320b0-0f60-4ac3-9519-44b66306b3b1\") " pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:44.063731 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:44.062694 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs\") pod \"network-metrics-daemon-bsgjj\" (UID: \"a5c657bf-dc1b-41f9-b16d-7d4336abdd69\") " pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:44.063731 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:44.062965 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:19:44.063731 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:44.063036 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs podName:a5c657bf-dc1b-41f9-b16d-7d4336abdd69 nodeName:}" failed. No retries permitted until 2026-07-06 14:19:46.063016132 +0000 UTC m=+6.146309396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs") pod "network-metrics-daemon-bsgjj" (UID: "a5c657bf-dc1b-41f9-b16d-7d4336abdd69") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:19:44.063731 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:44.063509 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:19:44.063731 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:44.063598 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret podName:5e1320b0-0f60-4ac3-9519-44b66306b3b1 nodeName:}" failed. No retries permitted until 2026-07-06 14:19:46.063581343 +0000 UTC m=+6.146874612 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret") pod "global-pull-secret-syncer-78ldj" (UID: "5e1320b0-0f60-4ac3-9519-44b66306b3b1") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:19:44.164492 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:44.163699 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l5wz\" (UniqueName: \"kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz\") pod \"network-check-target-2krbh\" (UID: \"e332c7f3-e91d-4c1d-b29f-1568b2853493\") " pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:19:44.164492 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:44.163956 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:19:44.164492 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:44.163996 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:19:44.164492 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:44.164010 2582 projected.go:196] Error preparing data for projected volume kube-api-access-4l5wz for pod openshift-network-diagnostics/network-check-target-2krbh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:19:44.164492 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:44.164137 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz podName:e332c7f3-e91d-4c1d-b29f-1568b2853493 nodeName:}" failed. No retries permitted until 2026-07-06 14:19:46.164117226 +0000 UTC m=+6.247410503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4l5wz" (UniqueName: "kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz") pod "network-check-target-2krbh" (UID: "e332c7f3-e91d-4c1d-b29f-1568b2853493") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:19:44.383958 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:44.383856 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 14:14:42 +0000 UTC" deadline="2028-03-16 06:42:05.947960808 +0000 UTC" Jul 06 14:19:44.383958 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:44.383900 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14848h22m21.564065776s" Jul 06 14:19:44.407559 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:44.407516 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:19:44.407707 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:44.407667 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2krbh" podUID="e332c7f3-e91d-4c1d-b29f-1568b2853493" Jul 06 14:19:44.408102 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:44.408080 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:44.408209 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:44.408184 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsgjj" podUID="a5c657bf-dc1b-41f9-b16d-7d4336abdd69" Jul 06 14:19:44.438937 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:44.438875 2582 generic.go:356] "Generic (PLEG): container finished" podID="264ba3c50c01053e42939662b94d2402" containerID="e826d253c55cfc1c392c7615e01af51d8c42d6eae0cbff54d8d9de795b9c09d1" exitCode=0 Jul 06 14:19:44.439105 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:44.439027 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal" event={"ID":"264ba3c50c01053e42939662b94d2402","Type":"ContainerDied","Data":"e826d253c55cfc1c392c7615e01af51d8c42d6eae0cbff54d8d9de795b9c09d1"} Jul 06 14:19:44.469409 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:44.469345 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-208.ec2.internal" event={"ID":"b8c6cec3a193d1bdd174e8ced89210cc","Type":"ContainerStarted","Data":"f147be1254a921055c5e9a92a54b44ddc834527829c01fd044967d68e99197da"} Jul 06 14:19:44.486026 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:44.485960 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-208.ec2.internal" podStartSLOduration=3.485939571 podStartE2EDuration="3.485939571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:19:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:19:44.485713211 +0000 UTC m=+4.569006485" watchObservedRunningTime="2026-07-06 14:19:44.485939571 +0000 UTC m=+4.569232844" Jul 06 14:19:45.407396 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:45.407346 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:45.407975 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:45.407484 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78ldj" podUID="5e1320b0-0f60-4ac3-9519-44b66306b3b1" Jul 06 14:19:45.479922 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:45.479836 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal" event={"ID":"264ba3c50c01053e42939662b94d2402","Type":"ContainerStarted","Data":"dc03754bce079e89940d432162e13926bfa5b338b9adc06679961536f826730a"} Jul 06 14:19:46.081515 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:46.081474 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret\") pod \"global-pull-secret-syncer-78ldj\" (UID: \"5e1320b0-0f60-4ac3-9519-44b66306b3b1\") " pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:46.081711 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:46.081535 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs\") pod \"network-metrics-daemon-bsgjj\" (UID: \"a5c657bf-dc1b-41f9-b16d-7d4336abdd69\") " pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:46.081775 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:46.081717 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:19:46.081828 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:46.081779 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs podName:a5c657bf-dc1b-41f9-b16d-7d4336abdd69 nodeName:}" failed. No retries permitted until 2026-07-06 14:19:50.081761157 +0000 UTC m=+10.165054414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs") pod "network-metrics-daemon-bsgjj" (UID: "a5c657bf-dc1b-41f9-b16d-7d4336abdd69") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:19:46.082178 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:46.082158 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:19:46.082262 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:46.082210 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret podName:5e1320b0-0f60-4ac3-9519-44b66306b3b1 nodeName:}" failed. No retries permitted until 2026-07-06 14:19:50.082196221 +0000 UTC m=+10.165489478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret") pod "global-pull-secret-syncer-78ldj" (UID: "5e1320b0-0f60-4ac3-9519-44b66306b3b1") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:19:46.182378 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:46.182338 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l5wz\" (UniqueName: \"kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz\") pod \"network-check-target-2krbh\" (UID: \"e332c7f3-e91d-4c1d-b29f-1568b2853493\") " pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:19:46.182640 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:46.182525 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:19:46.182640 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:46.182561 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:19:46.182640 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:46.182574 2582 projected.go:196] Error preparing data for projected volume kube-api-access-4l5wz for pod openshift-network-diagnostics/network-check-target-2krbh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:19:46.182640 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:46.182633 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz podName:e332c7f3-e91d-4c1d-b29f-1568b2853493 nodeName:}" failed. No retries permitted until 2026-07-06 14:19:50.182614978 +0000 UTC m=+10.265908233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4l5wz" (UniqueName: "kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz") pod "network-check-target-2krbh" (UID: "e332c7f3-e91d-4c1d-b29f-1568b2853493") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:19:46.408836 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:46.408756 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:46.409273 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:46.408904 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsgjj" podUID="a5c657bf-dc1b-41f9-b16d-7d4336abdd69" Jul 06 14:19:46.409335 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:46.409314 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:19:46.409431 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:46.409409 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2krbh" podUID="e332c7f3-e91d-4c1d-b29f-1568b2853493" Jul 06 14:19:47.407444 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:47.407406 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:47.407658 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:47.407563 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78ldj" podUID="5e1320b0-0f60-4ac3-9519-44b66306b3b1" Jul 06 14:19:48.406977 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:48.406941 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:48.406977 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:48.406988 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:19:48.407402 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:48.407105 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsgjj" podUID="a5c657bf-dc1b-41f9-b16d-7d4336abdd69" Jul 06 14:19:48.407402 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:48.407215 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2krbh" podUID="e332c7f3-e91d-4c1d-b29f-1568b2853493" Jul 06 14:19:49.407137 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:49.407090 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:49.407631 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:49.407226 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78ldj" podUID="5e1320b0-0f60-4ac3-9519-44b66306b3b1" Jul 06 14:19:50.116195 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:50.116154 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret\") pod \"global-pull-secret-syncer-78ldj\" (UID: \"5e1320b0-0f60-4ac3-9519-44b66306b3b1\") " pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:50.116195 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:50.116204 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs\") pod \"network-metrics-daemon-bsgjj\" (UID: \"a5c657bf-dc1b-41f9-b16d-7d4336abdd69\") " pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:50.116452 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:50.116321 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:19:50.116452 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:50.116322 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:19:50.116452 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:50.116391 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret podName:5e1320b0-0f60-4ac3-9519-44b66306b3b1 nodeName:}" failed. No retries permitted until 2026-07-06 14:19:58.116371371 +0000 UTC m=+18.199664637 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret") pod "global-pull-secret-syncer-78ldj" (UID: "5e1320b0-0f60-4ac3-9519-44b66306b3b1") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:19:50.116452 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:50.116412 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs podName:a5c657bf-dc1b-41f9-b16d-7d4336abdd69 nodeName:}" failed. No retries permitted until 2026-07-06 14:19:58.116401143 +0000 UTC m=+18.199694397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs") pod "network-metrics-daemon-bsgjj" (UID: "a5c657bf-dc1b-41f9-b16d-7d4336abdd69") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:19:50.216913 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:50.216869 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l5wz\" (UniqueName: \"kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz\") pod \"network-check-target-2krbh\" (UID: \"e332c7f3-e91d-4c1d-b29f-1568b2853493\") " pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:19:50.217105 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:50.217064 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:19:50.217105 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:50.217090 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:19:50.217105 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:50.217104 2582 projected.go:196] Error preparing data for projected volume kube-api-access-4l5wz for pod openshift-network-diagnostics/network-check-target-2krbh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:19:50.217251 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:50.217167 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz podName:e332c7f3-e91d-4c1d-b29f-1568b2853493 nodeName:}" failed. No retries permitted until 2026-07-06 14:19:58.217151255 +0000 UTC m=+18.300444526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4l5wz" (UniqueName: "kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz") pod "network-check-target-2krbh" (UID: "e332c7f3-e91d-4c1d-b29f-1568b2853493") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:19:50.409977 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:50.409895 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:50.409977 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:50.409934 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:19:50.410516 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:50.410034 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsgjj" podUID="a5c657bf-dc1b-41f9-b16d-7d4336abdd69" Jul 06 14:19:50.411052 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:50.411016 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2krbh" podUID="e332c7f3-e91d-4c1d-b29f-1568b2853493" Jul 06 14:19:51.407096 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:51.407010 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:51.407266 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:51.407144 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78ldj" podUID="5e1320b0-0f60-4ac3-9519-44b66306b3b1" Jul 06 14:19:52.410174 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:52.410144 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:52.410661 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:52.410284 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsgjj" podUID="a5c657bf-dc1b-41f9-b16d-7d4336abdd69" Jul 06 14:19:52.410661 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:52.410341 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:19:52.410661 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:52.410458 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2krbh" podUID="e332c7f3-e91d-4c1d-b29f-1568b2853493" Jul 06 14:19:53.406592 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:53.406537 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:53.406796 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:53.406686 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78ldj" podUID="5e1320b0-0f60-4ac3-9519-44b66306b3b1" Jul 06 14:19:54.406697 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:54.406664 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:19:54.407155 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:54.406664 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:54.407155 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:54.406821 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2krbh" podUID="e332c7f3-e91d-4c1d-b29f-1568b2853493" Jul 06 14:19:54.407155 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:54.406919 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsgjj" podUID="a5c657bf-dc1b-41f9-b16d-7d4336abdd69" Jul 06 14:19:55.407366 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:55.407337 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:55.407804 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:55.407446 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78ldj" podUID="5e1320b0-0f60-4ac3-9519-44b66306b3b1" Jul 06 14:19:56.407394 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:56.407363 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:19:56.407878 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:56.407370 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:56.407878 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:56.407506 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2krbh" podUID="e332c7f3-e91d-4c1d-b29f-1568b2853493" Jul 06 14:19:56.407878 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:56.407562 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsgjj" podUID="a5c657bf-dc1b-41f9-b16d-7d4336abdd69" Jul 06 14:19:57.407212 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:57.407173 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:57.407410 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:57.407281 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78ldj" podUID="5e1320b0-0f60-4ac3-9519-44b66306b3b1" Jul 06 14:19:58.175738 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:58.175701 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret\") pod \"global-pull-secret-syncer-78ldj\" (UID: \"5e1320b0-0f60-4ac3-9519-44b66306b3b1\") " pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:58.175738 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:58.175743 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs\") pod \"network-metrics-daemon-bsgjj\" (UID: \"a5c657bf-dc1b-41f9-b16d-7d4336abdd69\") " pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:58.176269 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:58.175861 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:19:58.176269 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:58.175863 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:19:58.176269 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:58.175921 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs podName:a5c657bf-dc1b-41f9-b16d-7d4336abdd69 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:14.175903349 +0000 UTC m=+34.259196617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs") pod "network-metrics-daemon-bsgjj" (UID: "a5c657bf-dc1b-41f9-b16d-7d4336abdd69") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:19:58.176269 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:58.175938 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret podName:5e1320b0-0f60-4ac3-9519-44b66306b3b1 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:14.175929498 +0000 UTC m=+34.259222750 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret") pod "global-pull-secret-syncer-78ldj" (UID: "5e1320b0-0f60-4ac3-9519-44b66306b3b1") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:19:58.276411 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:58.276375 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l5wz\" (UniqueName: \"kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz\") pod \"network-check-target-2krbh\" (UID: \"e332c7f3-e91d-4c1d-b29f-1568b2853493\") " pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:19:58.276622 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:58.276591 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:19:58.276622 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:58.276616 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:19:58.276725 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:58.276626 2582 projected.go:196] Error preparing data for projected volume kube-api-access-4l5wz for pod openshift-network-diagnostics/network-check-target-2krbh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:19:58.276725 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:58.276687 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz podName:e332c7f3-e91d-4c1d-b29f-1568b2853493 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:14.276668321 +0000 UTC m=+34.359961577 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4l5wz" (UniqueName: "kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz") pod "network-check-target-2krbh" (UID: "e332c7f3-e91d-4c1d-b29f-1568b2853493") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:19:58.407373 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:58.407333 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:19:58.407614 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:58.407334 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:19:58.407614 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:58.407464 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2krbh" podUID="e332c7f3-e91d-4c1d-b29f-1568b2853493" Jul 06 14:19:58.407614 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:58.407578 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsgjj" podUID="a5c657bf-dc1b-41f9-b16d-7d4336abdd69" Jul 06 14:19:59.407330 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:19:59.407296 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:19:59.407740 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:19:59.407425 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78ldj" podUID="5e1320b0-0f60-4ac3-9519-44b66306b3b1" Jul 06 14:20:00.408082 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:00.408053 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:20:00.408563 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:00.408501 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsgjj" podUID="a5c657bf-dc1b-41f9-b16d-7d4336abdd69" Jul 06 14:20:00.408696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:00.408675 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:20:00.408850 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:00.408825 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2krbh" podUID="e332c7f3-e91d-4c1d-b29f-1568b2853493" Jul 06 14:20:01.407260 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:01.407227 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:20:01.407451 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:01.407368 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78ldj" podUID="5e1320b0-0f60-4ac3-9519-44b66306b3b1" Jul 06 14:20:02.407652 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:02.407324 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:20:02.408232 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:02.407370 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:20:02.408232 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:02.407775 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2krbh" podUID="e332c7f3-e91d-4c1d-b29f-1568b2853493" Jul 06 14:20:02.408232 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:02.407833 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsgjj" podUID="a5c657bf-dc1b-41f9-b16d-7d4336abdd69" Jul 06 14:20:02.519053 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:02.519020 2582 generic.go:356] "Generic (PLEG): container finished" podID="b003ab99-dec8-40d2-b216-86af044f2a4c" containerID="08bed6d39477d53be0f1d39cd2026d6e22b975ca38533f35c8a77259e6873bdc" exitCode=0 Jul 06 14:20:02.519171 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:02.519094 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwfs6" event={"ID":"b003ab99-dec8-40d2-b216-86af044f2a4c","Type":"ContainerDied","Data":"08bed6d39477d53be0f1d39cd2026d6e22b975ca38533f35c8a77259e6873bdc"} Jul 06 14:20:02.520712 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:02.520687 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gkrh4" event={"ID":"2f5a6228-018c-4abe-b695-0be2d969f75f","Type":"ContainerStarted","Data":"c4c4fb5e295c41a6b8fa211a48147e0d298941b0b3dd075d8ad6889094d9250a"} Jul 06 14:20:02.522224 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:02.522203 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" event={"ID":"7728d473-ed46-4f23-8b65-2766d339dbd6","Type":"ContainerStarted","Data":"feff4d97c4c7b536c05e69f4d7cb5e2bf1ad4a32c2dd3572c14e1dde9066bbcd"} Jul 06 14:20:02.524649 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:02.524621 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" event={"ID":"eed3871e-c826-4955-a445-ff2f9dc62631","Type":"ContainerStarted","Data":"918183e934f0e0421e5e466d6845df6b1457bdd1205c1f09b5e36d709756ae6c"} Jul 06 14:20:02.524804 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:02.524707 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" event={"ID":"eed3871e-c826-4955-a445-ff2f9dc62631","Type":"ContainerStarted","Data":"d801318a42168cbf84881c763532526264ea643ab05696c29b5d2eb29a05d97d"} Jul 06 14:20:02.524804 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:02.524756 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" event={"ID":"eed3871e-c826-4955-a445-ff2f9dc62631","Type":"ContainerStarted","Data":"a092a88ebf0072747bd95a56cc713334b3fc7b3e0f2c3593ea4bf032d048cc0a"} Jul 06 14:20:02.526913 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:02.526345 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4gp2l" event={"ID":"0cb4fe3b-b20c-4913-8bb3-743295030fa8","Type":"ContainerStarted","Data":"f891d5347467320c69f1854b542d830575984c1f355d5452fd9e03743862854a"} Jul 06 14:20:02.528056 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:02.528029 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" event={"ID":"1acc289b-ad04-43f2-ab9c-b192286bbb75","Type":"ContainerStarted","Data":"e230ac01b3c6e93b5258b55f33c2cc0798806e3f9cbf538c6b981db32fe15fe5"} Jul 06 14:20:02.529493 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:02.529471 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wtlss" event={"ID":"4ee272d2-a9a5-4bda-b04a-c0833b785412","Type":"ContainerStarted","Data":"1366b9dd7a4737a15c323d46bac05ae6ae73d36bbde5fce5f125075fafa1102a"} Jul 06 14:20:02.530929 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:02.530906 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-59t7r" event={"ID":"e9f34edd-d08d-4870-b853-3e6fd9680f92","Type":"ContainerStarted","Data":"ab4e5f6a437c4a9c814179a3b699c0c416e6d6f0c21aa75cc361df040d265fd6"} Jul 06 14:20:02.546263 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:02.546212 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-208.ec2.internal" podStartSLOduration=21.54619959 podStartE2EDuration="21.54619959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:19:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:19:45.499841176 +0000 UTC m=+5.583134449" watchObservedRunningTime="2026-07-06 14:20:02.54619959 +0000 UTC m=+22.629492862" Jul 06 14:20:02.566083 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:02.566038 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4gp2l" podStartSLOduration=12.296126629 podStartE2EDuration="22.566023685s" totalImagesPullingTime="10.269897056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:02.565867344 +0000 UTC m=+22.649160617" watchObservedRunningTime="2026-07-06 14:20:02.566023685 +0000 UTC m=+22.649316956" Jul 06 14:20:02.591089 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:02.591040 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-59t7r" podStartSLOduration=3.671724299 podStartE2EDuration="22.591018104s" totalImagesPullingTime="18.919293805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:02.589516162 +0000 UTC m=+22.672809434" watchObservedRunningTime="2026-07-06 14:20:02.591018104 +0000 UTC m=+22.674311388" Jul 06 14:20:02.613628 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:02.613585 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wtlss" podStartSLOduration=3.92982043 podStartE2EDuration="22.613569489s" totalImagesPullingTime="18.683749059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:02.612912756 +0000 UTC m=+22.696206029" watchObservedRunningTime="2026-07-06 14:20:02.613569489 +0000 UTC m=+22.696862752" Jul 06 14:20:02.637376 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:02.637337 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lzn7h" podStartSLOduration=3.9356729440000002 podStartE2EDuration="22.637322245s" totalImagesPullingTime="18.701649301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:02.637300435 +0000 UTC m=+22.720593708" watchObservedRunningTime="2026-07-06 14:20:02.637322245 +0000 UTC m=+22.720615500" Jul 06 14:20:03.406771 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:03.406750 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:20:03.406878 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:03.406843 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78ldj" podUID="5e1320b0-0f60-4ac3-9519-44b66306b3b1" Jul 06 14:20:03.535447 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:03.535407 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f6vcn" event={"ID":"a5e65a06-cc77-4a3e-9eb2-c3cd36da5caf","Type":"ContainerStarted","Data":"e887f3d6c2273b7fb24564823e6bf69c8dd8f2a8e80ba8af1ef2a0e98839c6b1"} Jul 06 14:20:03.538956 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:03.538922 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" event={"ID":"eed3871e-c826-4955-a445-ff2f9dc62631","Type":"ContainerStarted","Data":"f254d94cd19bad8c3158387dec55c049d5d4465d9f15722983046d6ff62594e2"} Jul 06 14:20:03.539071 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:03.539012 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" event={"ID":"eed3871e-c826-4955-a445-ff2f9dc62631","Type":"ContainerStarted","Data":"a8ffc9bb8e8cd8478c6b8207a529c71de6806ee28f9ed1f8ba6594e172d7f00b"} Jul 06 14:20:03.539071 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:03.539053 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" event={"ID":"eed3871e-c826-4955-a445-ff2f9dc62631","Type":"ContainerStarted","Data":"d3fe72078d7df4e8b89981bda14cb9c3f6f5d48d1487a74bd05d670ec1eea417"} Jul 06 14:20:03.543465 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:03.543448 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 14:20:03.553368 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:03.553335 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gkrh4" podStartSLOduration=4.856230602 podStartE2EDuration="23.553321082s" totalImagesPullingTime="18.69709048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:02.657428857 +0000 UTC m=+22.740722140" watchObservedRunningTime="2026-07-06 14:20:03.553321082 +0000 UTC m=+23.636614346" Jul 06 14:20:03.553781 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:03.553753 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f6vcn" podStartSLOduration=5.276418317 podStartE2EDuration="23.553742317s" totalImagesPullingTime="18.277324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:03.553367625 +0000 UTC m=+23.636660900" watchObservedRunningTime="2026-07-06 14:20:03.553742317 +0000 UTC m=+23.637035608" Jul 06 14:20:04.407499 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:04.407471 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:20:04.407499 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:04.407490 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:20:04.407872 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:04.407602 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsgjj" podUID="a5c657bf-dc1b-41f9-b16d-7d4336abdd69" Jul 06 14:20:04.407872 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:04.407744 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2krbh" podUID="e332c7f3-e91d-4c1d-b29f-1568b2853493" Jul 06 14:20:04.409024 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:04.408956 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T14:20:03.543461027Z","UUID":"8032aa6a-1caf-490b-a9b0-fabe9341184e","Handler":null,"Name":"","Endpoint":""} Jul 06 14:20:04.410748 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:04.410721 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 14:20:04.410848 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:04.410760 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 14:20:04.546105 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:04.546071 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" event={"ID":"1acc289b-ad04-43f2-ab9c-b192286bbb75","Type":"ContainerStarted","Data":"760666af54a820381da6a6af276f6fc3fd5c0baf1916b235bfadb0fd2f28f716"} Jul 06 14:20:05.407558 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:05.407368 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:20:05.407755 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:05.407686 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78ldj" podUID="5e1320b0-0f60-4ac3-9519-44b66306b3b1" Jul 06 14:20:05.552191 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:05.552158 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" event={"ID":"eed3871e-c826-4955-a445-ff2f9dc62631","Type":"ContainerStarted","Data":"f9ac72672311a64a2d89fa86dd92c859775cbc36260c3684fa687e891a1bf826"} Jul 06 14:20:05.556533 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:05.556461 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" event={"ID":"1acc289b-ad04-43f2-ab9c-b192286bbb75","Type":"ContainerStarted","Data":"091d501b694faabecbdb47d6af6780db0e13639f789424d5aba817d20e8930e8"} Jul 06 14:20:06.406646 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:06.406609 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:20:06.406841 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:06.406618 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:20:06.406841 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:06.406748 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2krbh" podUID="e332c7f3-e91d-4c1d-b29f-1568b2853493" Jul 06 14:20:06.406841 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:06.406830 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsgjj" podUID="a5c657bf-dc1b-41f9-b16d-7d4336abdd69" Jul 06 14:20:06.971108 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:06.971040 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4gp2l" Jul 06 14:20:06.971711 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:06.971606 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4gp2l" Jul 06 14:20:06.988807 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:06.988762 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w8vbt" podStartSLOduration=5.782115567 podStartE2EDuration="26.988748922s" totalImagesPullingTime="21.206633355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:19:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:05.587230869 +0000 UTC m=+25.670524142" watchObservedRunningTime="2026-07-06 14:20:06.988748922 +0000 UTC m=+27.072042196" Jul 06 14:20:07.407574 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:07.407225 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:20:07.407574 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:07.407508 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78ldj" podUID="5e1320b0-0f60-4ac3-9519-44b66306b3b1" Jul 06 14:20:07.564693 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:07.564654 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" event={"ID":"eed3871e-c826-4955-a445-ff2f9dc62631","Type":"ContainerStarted","Data":"753f6c1c1db064acb9a4cd96065c03eaea2d931d2c1f665885e424bb6c5d59b4"} Jul 06 14:20:07.594086 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:07.594031 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" podStartSLOduration=8.838940805 podStartE2EDuration="27.5940162s" totalImagesPullingTime="18.755075395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:07.592700753 +0000 UTC m=+27.675994025" watchObservedRunningTime="2026-07-06 14:20:07.5940162 +0000 UTC m=+27.677309472" Jul 06 14:20:08.407078 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:08.407044 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:20:08.407882 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:08.407222 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsgjj" podUID="a5c657bf-dc1b-41f9-b16d-7d4336abdd69" Jul 06 14:20:08.407882 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:08.407267 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:20:08.407882 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:08.407377 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2krbh" podUID="e332c7f3-e91d-4c1d-b29f-1568b2853493" Jul 06 14:20:08.567864 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:08.567829 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:20:08.568029 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:08.567930 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:20:08.568029 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:08.567982 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:20:08.585763 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:08.585735 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:20:08.586632 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:08.586607 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:20:09.406860 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:09.406789 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:20:09.406981 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:09.406886 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78ldj" podUID="5e1320b0-0f60-4ac3-9519-44b66306b3b1" Jul 06 14:20:09.554377 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:09.554344 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-78ldj"] Jul 06 14:20:09.557275 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:09.557243 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bsgjj"] Jul 06 14:20:09.557412 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:09.557381 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:20:09.557521 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:09.557501 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsgjj" podUID="a5c657bf-dc1b-41f9-b16d-7d4336abdd69" Jul 06 14:20:09.560839 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:09.560815 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2krbh"] Jul 06 14:20:09.560943 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:09.560922 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:20:09.561036 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:09.561018 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2krbh" podUID="e332c7f3-e91d-4c1d-b29f-1568b2853493" Jul 06 14:20:09.571357 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:09.571329 2582 generic.go:356] "Generic (PLEG): container finished" podID="b003ab99-dec8-40d2-b216-86af044f2a4c" containerID="d95cc2ee3684373dbebda8c7076b3d71e99ac7ffcb569a3fe7b5141b19d1b1d9" exitCode=0 Jul 06 14:20:09.571497 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:09.571398 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:20:09.571497 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:09.571419 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwfs6" event={"ID":"b003ab99-dec8-40d2-b216-86af044f2a4c","Type":"ContainerDied","Data":"d95cc2ee3684373dbebda8c7076b3d71e99ac7ffcb569a3fe7b5141b19d1b1d9"} Jul 06 14:20:09.571629 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:09.571506 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78ldj" podUID="5e1320b0-0f60-4ac3-9519-44b66306b3b1" Jul 06 14:20:11.407261 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:11.407082 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:20:11.407666 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:11.407082 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:20:11.407666 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:11.407352 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsgjj" podUID="a5c657bf-dc1b-41f9-b16d-7d4336abdd69" Jul 06 14:20:11.407666 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:11.407082 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:20:11.407666 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:11.407442 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2krbh" podUID="e332c7f3-e91d-4c1d-b29f-1568b2853493" Jul 06 14:20:11.407666 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:11.407505 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78ldj" podUID="5e1320b0-0f60-4ac3-9519-44b66306b3b1" Jul 06 14:20:11.578341 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:11.578305 2582 generic.go:356] "Generic (PLEG): container finished" podID="b003ab99-dec8-40d2-b216-86af044f2a4c" containerID="00c1d926b9cf4e6741b970814fe0db2db06a98ea46b4a67d23f636d0156a0642" exitCode=0 Jul 06 14:20:11.578496 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:11.578368 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwfs6" event={"ID":"b003ab99-dec8-40d2-b216-86af044f2a4c","Type":"ContainerDied","Data":"00c1d926b9cf4e6741b970814fe0db2db06a98ea46b4a67d23f636d0156a0642"} Jul 06 14:20:12.361834 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:12.361800 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4gp2l" Jul 06 14:20:12.362029 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:12.361934 2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 14:20:12.362540 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:12.362485 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4gp2l" Jul 06 14:20:12.583515 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:12.583434 2582 generic.go:356] "Generic (PLEG): container finished" podID="b003ab99-dec8-40d2-b216-86af044f2a4c" containerID="e3ef17c74b7abd316161feaf5b73b6db5dd1ab387449d740435e77e2b28a78fa" exitCode=0 Jul 06 14:20:12.583996 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:12.583514 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwfs6" event={"ID":"b003ab99-dec8-40d2-b216-86af044f2a4c","Type":"ContainerDied","Data":"e3ef17c74b7abd316161feaf5b73b6db5dd1ab387449d740435e77e2b28a78fa"} Jul 06 14:20:13.406538 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:13.406482 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:20:13.406538 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:13.406536 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:20:13.406771 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:13.406511 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:20:13.406771 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:13.406650 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2krbh" podUID="e332c7f3-e91d-4c1d-b29f-1568b2853493" Jul 06 14:20:13.406771 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:13.406720 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78ldj" podUID="5e1320b0-0f60-4ac3-9519-44b66306b3b1" Jul 06 14:20:13.406858 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:13.406809 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsgjj" podUID="a5c657bf-dc1b-41f9-b16d-7d4336abdd69" Jul 06 14:20:14.202776 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:14.202739 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret\") pod \"global-pull-secret-syncer-78ldj\" (UID: \"5e1320b0-0f60-4ac3-9519-44b66306b3b1\") " pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:20:14.203289 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:14.202916 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:20:14.203289 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:14.202919 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs\") pod \"network-metrics-daemon-bsgjj\" (UID: \"a5c657bf-dc1b-41f9-b16d-7d4336abdd69\") " pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:20:14.203289 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:14.203007 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:20:14.203289 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:14.203030 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret podName:5e1320b0-0f60-4ac3-9519-44b66306b3b1 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:46.202962616 +0000 UTC m=+66.286255882 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret") pod "global-pull-secret-syncer-78ldj" (UID: "5e1320b0-0f60-4ac3-9519-44b66306b3b1") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:20:14.203289 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:14.203061 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs podName:a5c657bf-dc1b-41f9-b16d-7d4336abdd69 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:46.203044636 +0000 UTC m=+66.286337887 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs") pod "network-metrics-daemon-bsgjj" (UID: "a5c657bf-dc1b-41f9-b16d-7d4336abdd69") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:20:14.303559 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:14.303504 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l5wz\" (UniqueName: \"kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz\") pod \"network-check-target-2krbh\" (UID: \"e332c7f3-e91d-4c1d-b29f-1568b2853493\") " pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:20:14.303733 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:14.303680 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:20:14.303733 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:14.303704 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:20:14.303733 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:14.303713 2582 projected.go:196] Error preparing data for projected volume kube-api-access-4l5wz for pod openshift-network-diagnostics/network-check-target-2krbh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:20:14.303873 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:14.303772 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz podName:e332c7f3-e91d-4c1d-b29f-1568b2853493 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:46.3037579 +0000 UTC m=+66.387051151 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4l5wz" (UniqueName: "kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz") pod "network-check-target-2krbh" (UID: "e332c7f3-e91d-4c1d-b29f-1568b2853493") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:20:15.122426 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.122400 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-208.ec2.internal" event="NodeReady" Jul 06 14:20:15.122717 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.122532 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 14:20:15.159665 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.159634 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d8849664b-8l2fw"] Jul 06 14:20:15.162125 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.162087 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.167582 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.167561 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 14:20:15.167829 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.167814 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 14:20:15.167998 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.167984 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 14:20:15.168377 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.168350 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xn2mh\"" Jul 06 14:20:15.174677 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.174656 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 14:20:15.181043 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.181018 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d8849664b-8l2fw"] Jul 06 14:20:15.186335 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.186306 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pwplc"] Jul 06 14:20:15.189432 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.189378 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pwplc" Jul 06 14:20:15.190269 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.190249 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-546wb"] Jul 06 14:20:15.192108 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.192091 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 14:20:15.192345 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.192327 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 14:20:15.192889 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.192869 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-546wb" Jul 06 14:20:15.193937 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.193795 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tng92\"" Jul 06 14:20:15.195231 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.195211 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 14:20:15.195369 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.195305 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 14:20:15.195521 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.195507 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 14:20:15.195619 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.195536 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9fk4j\"" Jul 06 14:20:15.201963 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.201937 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pwplc"] Jul 06 14:20:15.206913 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.206888 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-546wb"] Jul 06 14:20:15.311908 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.311873 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6458c\" (UniqueName: \"kubernetes.io/projected/237f8a8c-6481-4ffa-b117-9a00b63917e4-kube-api-access-6458c\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:20:15.312087 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.311918 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-installation-pull-secrets\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.312087 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.311951 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-certificates\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.312087 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.311974 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-trusted-ca\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.312087 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.312003 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:20:15.312087 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.312033 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/237f8a8c-6481-4ffa-b117-9a00b63917e4-config-volume\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:20:15.312087 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.312056 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lg5t\" (UniqueName: \"kubernetes.io/projected/5d751f46-4d3b-42b0-ae32-1215e09a5669-kube-api-access-9lg5t\") pod \"ingress-canary-546wb\" (UID: \"5d751f46-4d3b-42b0-ae32-1215e09a5669\") " pod="openshift-ingress-canary/ingress-canary-546wb" Jul 06 14:20:15.312364 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.312109 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/237f8a8c-6481-4ffa-b117-9a00b63917e4-tmp-dir\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:20:15.312364 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.312131 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-bound-sa-token\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.312364 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.312168 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckvwt\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-kube-api-access-ckvwt\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.312364 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.312211 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-ca-trust-extracted\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.312364 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.312251 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d751f46-4d3b-42b0-ae32-1215e09a5669-cert\") pod \"ingress-canary-546wb\" (UID: \"5d751f46-4d3b-42b0-ae32-1215e09a5669\") " pod="openshift-ingress-canary/ingress-canary-546wb" Jul 06 14:20:15.312364 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.312270 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-image-registry-private-configuration\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.312364 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.312289 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.406955 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.406867 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:20:15.406955 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.406909 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:20:15.407151 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.406987 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:20:15.410003 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.409974 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 14:20:15.410154 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.410017 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 14:20:15.410154 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.410060 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 14:20:15.410154 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.410085 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nfstm\"" Jul 06 14:20:15.410307 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.410261 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 14:20:15.410307 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.410272 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-74wbt\"" Jul 06 14:20:15.412614 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.412583 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:20:15.412738 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.412629 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/237f8a8c-6481-4ffa-b117-9a00b63917e4-config-volume\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:20:15.412738 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.412657 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lg5t\" (UniqueName: \"kubernetes.io/projected/5d751f46-4d3b-42b0-ae32-1215e09a5669-kube-api-access-9lg5t\") pod \"ingress-canary-546wb\" (UID: \"5d751f46-4d3b-42b0-ae32-1215e09a5669\") " pod="openshift-ingress-canary/ingress-canary-546wb" Jul 06 14:20:15.412849 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:15.412742 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 14:20:15.412849 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:15.412804 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls podName:237f8a8c-6481-4ffa-b117-9a00b63917e4 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:15.912782585 +0000 UTC m=+35.996075838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls") pod "dns-default-pwplc" (UID: "237f8a8c-6481-4ffa-b117-9a00b63917e4") : secret "dns-default-metrics-tls" not found Jul 06 14:20:15.413133 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.413108 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/237f8a8c-6481-4ffa-b117-9a00b63917e4-tmp-dir\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:20:15.413261 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.413149 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-bound-sa-token\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.413261 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.413179 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckvwt\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-kube-api-access-ckvwt\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.413261 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.413184 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/237f8a8c-6481-4ffa-b117-9a00b63917e4-config-volume\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:20:15.413261 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.413224 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-ca-trust-extracted\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.413459 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.413263 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d751f46-4d3b-42b0-ae32-1215e09a5669-cert\") pod \"ingress-canary-546wb\" (UID: \"5d751f46-4d3b-42b0-ae32-1215e09a5669\") " pod="openshift-ingress-canary/ingress-canary-546wb" Jul 06 14:20:15.413459 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.413292 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-image-registry-private-configuration\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.413459 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.413318 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.413459 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.413349 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6458c\" (UniqueName: \"kubernetes.io/projected/237f8a8c-6481-4ffa-b117-9a00b63917e4-kube-api-access-6458c\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:20:15.413459 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.413377 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-installation-pull-secrets\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.413459 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.413406 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-certificates\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.413459 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.413429 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-trusted-ca\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.413860 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.413430 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/237f8a8c-6481-4ffa-b117-9a00b63917e4-tmp-dir\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:20:15.413860 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:15.413664 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 14:20:15.413860 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:15.413679 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8849664b-8l2fw: secret "image-registry-tls" not found Jul 06 14:20:15.413860 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:15.413739 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls podName:38aa2d4f-ea9a-487a-9f1e-b322547d81d3 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:15.91372224 +0000 UTC m=+35.997015511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls") pod "image-registry-7d8849664b-8l2fw" (UID: "38aa2d4f-ea9a-487a-9f1e-b322547d81d3") : secret "image-registry-tls" not found Jul 06 14:20:15.414154 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.414132 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-ca-trust-extracted\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.415070 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.414248 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-certificates\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.416369 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.416344 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-trusted-ca\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.417819 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.417773 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-image-registry-private-configuration\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.417819 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.417789 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-installation-pull-secrets\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.417819 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.417791 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d751f46-4d3b-42b0-ae32-1215e09a5669-cert\") pod \"ingress-canary-546wb\" (UID: \"5d751f46-4d3b-42b0-ae32-1215e09a5669\") " pod="openshift-ingress-canary/ingress-canary-546wb" Jul 06 14:20:15.422329 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.422299 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-bound-sa-token\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.422436 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.422358 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckvwt\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-kube-api-access-ckvwt\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.422498 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.422464 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lg5t\" (UniqueName: \"kubernetes.io/projected/5d751f46-4d3b-42b0-ae32-1215e09a5669-kube-api-access-9lg5t\") pod \"ingress-canary-546wb\" (UID: \"5d751f46-4d3b-42b0-ae32-1215e09a5669\") " pod="openshift-ingress-canary/ingress-canary-546wb" Jul 06 14:20:15.422574 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.422510 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6458c\" (UniqueName: \"kubernetes.io/projected/237f8a8c-6481-4ffa-b117-9a00b63917e4-kube-api-access-6458c\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:20:15.508336 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.508300 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-546wb" Jul 06 14:20:15.664643 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.664373 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-546wb"] Jul 06 14:20:15.916785 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.916698 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:15.916785 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:15.916755 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:20:15.917012 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:15.916852 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 14:20:15.917012 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:15.916874 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8849664b-8l2fw: secret "image-registry-tls" not found Jul 06 14:20:15.917012 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:15.916910 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 14:20:15.917012 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:15.916967 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls podName:38aa2d4f-ea9a-487a-9f1e-b322547d81d3 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:16.916945275 +0000 UTC m=+37.000238529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls") pod "image-registry-7d8849664b-8l2fw" (UID: "38aa2d4f-ea9a-487a-9f1e-b322547d81d3") : secret "image-registry-tls" not found Jul 06 14:20:15.917012 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:15.916984 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls podName:237f8a8c-6481-4ffa-b117-9a00b63917e4 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:16.916977722 +0000 UTC m=+37.000270974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls") pod "dns-default-pwplc" (UID: "237f8a8c-6481-4ffa-b117-9a00b63917e4") : secret "dns-default-metrics-tls" not found Jul 06 14:20:16.925685 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:16.925649 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:20:16.926270 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:16.925777 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:16.926270 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:16.925823 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 14:20:16.926270 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:16.925909 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls podName:237f8a8c-6481-4ffa-b117-9a00b63917e4 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:18.925886476 +0000 UTC m=+39.009179751 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls") pod "dns-default-pwplc" (UID: "237f8a8c-6481-4ffa-b117-9a00b63917e4") : secret "dns-default-metrics-tls" not found Jul 06 14:20:16.926270 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:16.925931 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 14:20:16.926270 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:16.925949 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8849664b-8l2fw: secret "image-registry-tls" not found Jul 06 14:20:16.926270 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:16.926012 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls podName:38aa2d4f-ea9a-487a-9f1e-b322547d81d3 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:18.925988261 +0000 UTC m=+39.009281534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls") pod "image-registry-7d8849664b-8l2fw" (UID: "38aa2d4f-ea9a-487a-9f1e-b322547d81d3") : secret "image-registry-tls" not found Jul 06 14:20:17.001926 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:20:17.001891 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d751f46_4d3b_42b0_ae32_1215e09a5669.slice/crio-8ab067fa42b2f353b50cb575c24c4faaca1b607593e7cbe8ca4388c6f8a2bf2e WatchSource:0}: Error finding container 8ab067fa42b2f353b50cb575c24c4faaca1b607593e7cbe8ca4388c6f8a2bf2e: Status 404 returned error can't find the container with id 8ab067fa42b2f353b50cb575c24c4faaca1b607593e7cbe8ca4388c6f8a2bf2e Jul 06 14:20:17.598879 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:17.598837 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-546wb" event={"ID":"5d751f46-4d3b-42b0-ae32-1215e09a5669","Type":"ContainerStarted","Data":"8ab067fa42b2f353b50cb575c24c4faaca1b607593e7cbe8ca4388c6f8a2bf2e"} Jul 06 14:20:17.601378 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:17.601351 2582 generic.go:356] "Generic (PLEG): container finished" podID="b003ab99-dec8-40d2-b216-86af044f2a4c" containerID="a115c2453693a8bb196e6fe62428667cbdae0b711e407559e511826e63bb21b8" exitCode=0 Jul 06 14:20:17.601503 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:17.601398 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwfs6" event={"ID":"b003ab99-dec8-40d2-b216-86af044f2a4c","Type":"ContainerDied","Data":"a115c2453693a8bb196e6fe62428667cbdae0b711e407559e511826e63bb21b8"} Jul 06 14:20:17.793046 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:17.793008 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:17.890212 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:17.890107 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:17.994025 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:17.993985 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:18.605940 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:18.605904 2582 generic.go:356] "Generic (PLEG): container finished" podID="b003ab99-dec8-40d2-b216-86af044f2a4c" containerID="3db1eff876d2dc25d4cef2975868ab9c85c619c181f21294038f8508080faf73" exitCode=0 Jul 06 14:20:18.606102 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:18.605955 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwfs6" event={"ID":"b003ab99-dec8-40d2-b216-86af044f2a4c","Type":"ContainerDied","Data":"3db1eff876d2dc25d4cef2975868ab9c85c619c181f21294038f8508080faf73"} Jul 06 14:20:18.944698 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:18.944393 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:18.944698 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:18.944681 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:20:18.944913 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:18.944559 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 14:20:18.944913 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:18.944737 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8849664b-8l2fw: secret "image-registry-tls" not found Jul 06 14:20:18.944913 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:18.944803 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls podName:38aa2d4f-ea9a-487a-9f1e-b322547d81d3 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:22.944785129 +0000 UTC m=+43.028078400 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls") pod "image-registry-7d8849664b-8l2fw" (UID: "38aa2d4f-ea9a-487a-9f1e-b322547d81d3") : secret "image-registry-tls" not found Jul 06 14:20:18.944913 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:18.944806 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 14:20:18.944913 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:18.944854 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls podName:237f8a8c-6481-4ffa-b117-9a00b63917e4 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:22.944840075 +0000 UTC m=+43.028133327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls") pod "dns-default-pwplc" (UID: "237f8a8c-6481-4ffa-b117-9a00b63917e4") : secret "dns-default-metrics-tls" not found Jul 06 14:20:19.612808 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:19.612767 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwfs6" event={"ID":"b003ab99-dec8-40d2-b216-86af044f2a4c","Type":"ContainerStarted","Data":"9388aa14d1acd7e766115ba3f4576b0f3989bcc11d61fcaa527a86d76a072e7c"} Jul 06 14:20:19.642342 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:19.642272 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pwfs6" podStartSLOduration=7.896665142 podStartE2EDuration="39.642253806s" totalImagesPullingTime="31.745588664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:19:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:19.641786575 +0000 UTC m=+39.725079841" watchObservedRunningTime="2026-07-06 14:20:19.642253806 +0000 UTC m=+39.725547078" Jul 06 14:20:19.773354 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:19.773317 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:19.900181 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:19.900088 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:20.047835 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:20.047786 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:20.288205 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:20.288169 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:20.400377 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:20.400347 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:20.617959 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:20.617914 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-546wb" event={"ID":"5d751f46-4d3b-42b0-ae32-1215e09a5669","Type":"ContainerStarted","Data":"f66b36554bc8a1f60c7f08ffcd12244a0eaca2022e281eb7dc4b478c44ff2094"} Jul 06 14:20:20.636543 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:20.636484 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-546wb" podStartSLOduration=2.214501336 podStartE2EDuration="5.636466507s" totalImagesPullingTime="3.421965171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:20:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:20.635896718 +0000 UTC m=+40.719189991" watchObservedRunningTime="2026-07-06 14:20:20.636466507 +0000 UTC m=+40.719759780" Jul 06 14:20:20.722243 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:20.722205 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:20.792757 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:20.792726 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:21.111981 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:21.111942 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:21.176858 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:21.176826 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:22.183035 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:22.182996 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:22.283869 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:22.283836 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:22.384450 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:22.384421 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:22.978743 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:22.978701 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:22.978893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:22.978754 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:20:22.978893 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:22.978861 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 14:20:22.978893 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:22.978869 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 14:20:22.978893 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:22.978877 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8849664b-8l2fw: secret "image-registry-tls" not found Jul 06 14:20:22.979030 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:22.978923 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls podName:237f8a8c-6481-4ffa-b117-9a00b63917e4 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:30.978910829 +0000 UTC m=+51.062204080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls") pod "dns-default-pwplc" (UID: "237f8a8c-6481-4ffa-b117-9a00b63917e4") : secret "dns-default-metrics-tls" not found Jul 06 14:20:22.979030 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:22.978936 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls podName:38aa2d4f-ea9a-487a-9f1e-b322547d81d3 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:30.978930437 +0000 UTC m=+51.062223688 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls") pod "image-registry-7d8849664b-8l2fw" (UID: "38aa2d4f-ea9a-487a-9f1e-b322547d81d3") : secret "image-registry-tls" not found Jul 06 14:20:24.727059 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:24.727026 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:24.828168 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:24.828126 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:31.042627 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:31.042591 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:20:31.043175 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:31.042673 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:31.043175 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:31.042770 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 14:20:31.043175 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:31.042776 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 14:20:31.043175 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:31.042782 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8849664b-8l2fw: secret "image-registry-tls" not found Jul 06 14:20:31.043175 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:31.042873 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls podName:237f8a8c-6481-4ffa-b117-9a00b63917e4 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:47.042850853 +0000 UTC m=+67.126144140 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls") pod "dns-default-pwplc" (UID: "237f8a8c-6481-4ffa-b117-9a00b63917e4") : secret "dns-default-metrics-tls" not found Jul 06 14:20:31.043175 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:31.042918 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls podName:38aa2d4f-ea9a-487a-9f1e-b322547d81d3 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:47.042906286 +0000 UTC m=+67.126199537 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls") pod "image-registry-7d8849664b-8l2fw" (UID: "38aa2d4f-ea9a-487a-9f1e-b322547d81d3") : secret "image-registry-tls" not found Jul 06 14:20:34.945820 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:34.945780 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:35.069083 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:35.069041 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:35.168855 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:35.168824 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:38.477317 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:38.477287 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:40.594751 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:40.594722 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tntzk" Jul 06 14:20:40.788197 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:40.788158 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:40.847043 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:40.846954 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:41.495965 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.495933 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-d6v8z"] Jul 06 14:20:41.498876 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.498860 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc"] Jul 06 14:20:41.498993 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.498975 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-d6v8z" Jul 06 14:20:41.500980 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.500959 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" Jul 06 14:20:41.501993 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.501974 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-s4zjd\"" Jul 06 14:20:41.502106 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.501989 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 14:20:41.502106 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.502049 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 14:20:41.504536 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.504514 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 14:20:41.504665 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.504648 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 14:20:41.504739 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.504727 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 14:20:41.504784 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.504746 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wgxmr\"" Jul 06 14:20:41.505829 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.505747 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 14:20:41.511017 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.510996 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5d778f859f-t8gjz"] Jul 06 14:20:41.513600 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.513581 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-d6v8z"] Jul 06 14:20:41.513682 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.513610 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc"] Jul 06 14:20:41.513682 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.513680 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:41.516130 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.516110 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 14:20:41.516229 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.516110 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 14:20:41.516229 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.516216 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-p7pmk\"" Jul 06 14:20:41.516336 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.516242 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 14:20:41.516390 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.516357 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 14:20:41.516588 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.516541 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 14:20:41.516660 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.516646 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 14:20:41.529068 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.529045 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d778f859f-t8gjz"] Jul 06 14:20:41.604721 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.604692 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc"] Jul 06 14:20:41.608025 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.607993 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc" Jul 06 14:20:41.613008 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.612987 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 14:20:41.613122 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.613057 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 14:20:41.613637 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.613622 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-cd969\"" Jul 06 14:20:41.613824 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.613811 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 14:20:41.614020 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.614007 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 14:20:41.618600 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.618582 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6d9866-81db-423a-b0ff-75a455a72619-service-ca-bundle\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:41.618723 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.618615 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-default-certificate\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:41.618723 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.618651 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4zg9\" (UniqueName: \"kubernetes.io/projected/f132d7c3-f91f-45c9-ae32-c98809a6efd5-kube-api-access-g4zg9\") pod \"cluster-monitoring-operator-64786d9cbb-4ddqc\" (UID: \"f132d7c3-f91f-45c9-ae32-c98809a6efd5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" Jul 06 14:20:41.618723 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.618702 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhvxl\" (UniqueName: \"kubernetes.io/projected/7af9649f-329f-4a61-b91b-964ec516a88b-kube-api-access-bhvxl\") pod \"volume-data-source-validator-5d456fdbcd-d6v8z\" (UID: \"7af9649f-329f-4a61-b91b-964ec516a88b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-d6v8z" Jul 06 14:20:41.618853 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.618751 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f132d7c3-f91f-45c9-ae32-c98809a6efd5-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-4ddqc\" (UID: \"f132d7c3-f91f-45c9-ae32-c98809a6efd5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" Jul 06 14:20:41.618853 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.618787 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-metrics-certs\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:41.618956 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.618861 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxndn\" (UniqueName: \"kubernetes.io/projected/0d6d9866-81db-423a-b0ff-75a455a72619-kube-api-access-qxndn\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:41.618956 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.618936 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f132d7c3-f91f-45c9-ae32-c98809a6efd5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4ddqc\" (UID: \"f132d7c3-f91f-45c9-ae32-c98809a6efd5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" Jul 06 14:20:41.619055 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.618966 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-stats-auth\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:41.619884 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.619866 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc"] Jul 06 14:20:41.713340 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.713303 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:41.720272 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.720249 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6d9866-81db-423a-b0ff-75a455a72619-service-ca-bundle\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:41.720379 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.720281 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b10bd373-75a4-47dc-9848-85868203da06-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-x2tgc\" (UID: \"b10bd373-75a4-47dc-9848-85868203da06\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc" Jul 06 14:20:41.720379 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.720308 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-default-certificate\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:41.720456 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:41.720410 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d6d9866-81db-423a-b0ff-75a455a72619-service-ca-bundle podName:0d6d9866-81db-423a-b0ff-75a455a72619 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:42.220390811 +0000 UTC m=+62.303684063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0d6d9866-81db-423a-b0ff-75a455a72619-service-ca-bundle") pod "router-default-5d778f859f-t8gjz" (UID: "0d6d9866-81db-423a-b0ff-75a455a72619") : configmap references non-existent config key: service-ca.crt Jul 06 14:20:41.720456 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.720443 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4zg9\" (UniqueName: \"kubernetes.io/projected/f132d7c3-f91f-45c9-ae32-c98809a6efd5-kube-api-access-g4zg9\") pod \"cluster-monitoring-operator-64786d9cbb-4ddqc\" (UID: \"f132d7c3-f91f-45c9-ae32-c98809a6efd5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" Jul 06 14:20:41.720567 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.720462 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2ncq\" (UniqueName: \"kubernetes.io/projected/b10bd373-75a4-47dc-9848-85868203da06-kube-api-access-k2ncq\") pod \"service-ca-operator-5d46d9ffd4-x2tgc\" (UID: \"b10bd373-75a4-47dc-9848-85868203da06\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc" Jul 06 14:20:41.720567 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.720487 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhvxl\" (UniqueName: \"kubernetes.io/projected/7af9649f-329f-4a61-b91b-964ec516a88b-kube-api-access-bhvxl\") pod \"volume-data-source-validator-5d456fdbcd-d6v8z\" (UID: \"7af9649f-329f-4a61-b91b-964ec516a88b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-d6v8z" Jul 06 14:20:41.720653 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.720539 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b10bd373-75a4-47dc-9848-85868203da06-config\") pod \"service-ca-operator-5d46d9ffd4-x2tgc\" (UID: \"b10bd373-75a4-47dc-9848-85868203da06\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc" Jul 06 14:20:41.720653 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.720607 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f132d7c3-f91f-45c9-ae32-c98809a6efd5-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-4ddqc\" (UID: \"f132d7c3-f91f-45c9-ae32-c98809a6efd5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" Jul 06 14:20:41.720653 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.720632 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-metrics-certs\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:41.720755 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.720670 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxndn\" (UniqueName: \"kubernetes.io/projected/0d6d9866-81db-423a-b0ff-75a455a72619-kube-api-access-qxndn\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:41.720800 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:41.720755 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 14:20:41.720848 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.720821 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f132d7c3-f91f-45c9-ae32-c98809a6efd5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4ddqc\" (UID: \"f132d7c3-f91f-45c9-ae32-c98809a6efd5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" Jul 06 14:20:41.720848 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:41.720830 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-metrics-certs podName:0d6d9866-81db-423a-b0ff-75a455a72619 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:42.220818295 +0000 UTC m=+62.304111546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-metrics-certs") pod "router-default-5d778f859f-t8gjz" (UID: "0d6d9866-81db-423a-b0ff-75a455a72619") : secret "router-metrics-certs-default" not found Jul 06 14:20:41.720950 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.720874 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-stats-auth\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:41.720950 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:41.720882 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 14:20:41.720950 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:41.720910 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f132d7c3-f91f-45c9-ae32-c98809a6efd5-cluster-monitoring-operator-tls podName:f132d7c3-f91f-45c9-ae32-c98809a6efd5 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:42.220901346 +0000 UTC m=+62.304194597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f132d7c3-f91f-45c9-ae32-c98809a6efd5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4ddqc" (UID: "f132d7c3-f91f-45c9-ae32-c98809a6efd5") : secret "cluster-monitoring-operator-tls" not found Jul 06 14:20:41.721206 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.721189 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f132d7c3-f91f-45c9-ae32-c98809a6efd5-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-4ddqc\" (UID: \"f132d7c3-f91f-45c9-ae32-c98809a6efd5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" Jul 06 14:20:41.724386 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.724364 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-default-certificate\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:41.724497 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.724398 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-stats-auth\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:41.731705 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.731684 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxndn\" (UniqueName: \"kubernetes.io/projected/0d6d9866-81db-423a-b0ff-75a455a72619-kube-api-access-qxndn\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:41.732092 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.732069 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4zg9\" (UniqueName: \"kubernetes.io/projected/f132d7c3-f91f-45c9-ae32-c98809a6efd5-kube-api-access-g4zg9\") pod \"cluster-monitoring-operator-64786d9cbb-4ddqc\" (UID: \"f132d7c3-f91f-45c9-ae32-c98809a6efd5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" Jul 06 14:20:41.732221 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.732204 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhvxl\" (UniqueName: \"kubernetes.io/projected/7af9649f-329f-4a61-b91b-964ec516a88b-kube-api-access-bhvxl\") pod \"volume-data-source-validator-5d456fdbcd-d6v8z\" (UID: \"7af9649f-329f-4a61-b91b-964ec516a88b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-d6v8z" Jul 06 14:20:41.809568 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.809520 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-d6v8z" Jul 06 14:20:41.817011 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.816977 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:41.822139 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.822116 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b10bd373-75a4-47dc-9848-85868203da06-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-x2tgc\" (UID: \"b10bd373-75a4-47dc-9848-85868203da06\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc" Jul 06 14:20:41.822243 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.822172 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2ncq\" (UniqueName: \"kubernetes.io/projected/b10bd373-75a4-47dc-9848-85868203da06-kube-api-access-k2ncq\") pod \"service-ca-operator-5d46d9ffd4-x2tgc\" (UID: \"b10bd373-75a4-47dc-9848-85868203da06\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc" Jul 06 14:20:41.822243 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.822196 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b10bd373-75a4-47dc-9848-85868203da06-config\") pod \"service-ca-operator-5d46d9ffd4-x2tgc\" (UID: \"b10bd373-75a4-47dc-9848-85868203da06\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc" Jul 06 14:20:41.822701 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.822675 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b10bd373-75a4-47dc-9848-85868203da06-config\") pod \"service-ca-operator-5d46d9ffd4-x2tgc\" (UID: \"b10bd373-75a4-47dc-9848-85868203da06\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc" Jul 06 14:20:41.824297 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.824257 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b10bd373-75a4-47dc-9848-85868203da06-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-x2tgc\" (UID: \"b10bd373-75a4-47dc-9848-85868203da06\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc" Jul 06 14:20:41.831149 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.831128 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2ncq\" (UniqueName: \"kubernetes.io/projected/b10bd373-75a4-47dc-9848-85868203da06-kube-api-access-k2ncq\") pod \"service-ca-operator-5d46d9ffd4-x2tgc\" (UID: \"b10bd373-75a4-47dc-9848-85868203da06\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc" Jul 06 14:20:41.918069 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.918038 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc" Jul 06 14:20:41.933557 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:41.933513 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-d6v8z"] Jul 06 14:20:41.937659 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:20:41.937628 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af9649f_329f_4a61_b91b_964ec516a88b.slice/crio-64e1ea15b75f2b66f2011ce8a51d783ca2e333b79a3b8ba86043af3bb549c9e4 WatchSource:0}: Error finding container 64e1ea15b75f2b66f2011ce8a51d783ca2e333b79a3b8ba86043af3bb549c9e4: Status 404 returned error can't find the container with id 64e1ea15b75f2b66f2011ce8a51d783ca2e333b79a3b8ba86043af3bb549c9e4 Jul 06 14:20:42.045307 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:42.045275 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc"] Jul 06 14:20:42.047893 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:20:42.047865 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb10bd373_75a4_47dc_9848_85868203da06.slice/crio-ded930475b9c156c212f662ddb4862667570dd03339538a0adfe69cf13aa390a WatchSource:0}: Error finding container ded930475b9c156c212f662ddb4862667570dd03339538a0adfe69cf13aa390a: Status 404 returned error can't find the container with id ded930475b9c156c212f662ddb4862667570dd03339538a0adfe69cf13aa390a Jul 06 14:20:42.224956 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:42.224855 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6d9866-81db-423a-b0ff-75a455a72619-service-ca-bundle\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:42.224956 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:42.224935 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-metrics-certs\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:42.225151 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:42.224986 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f132d7c3-f91f-45c9-ae32-c98809a6efd5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4ddqc\" (UID: \"f132d7c3-f91f-45c9-ae32-c98809a6efd5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" Jul 06 14:20:42.225151 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:42.225027 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d6d9866-81db-423a-b0ff-75a455a72619-service-ca-bundle podName:0d6d9866-81db-423a-b0ff-75a455a72619 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:43.225009198 +0000 UTC m=+63.308302480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0d6d9866-81db-423a-b0ff-75a455a72619-service-ca-bundle") pod "router-default-5d778f859f-t8gjz" (UID: "0d6d9866-81db-423a-b0ff-75a455a72619") : configmap references non-existent config key: service-ca.crt Jul 06 14:20:42.225151 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:42.225072 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 14:20:42.225151 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:42.225079 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 14:20:42.225151 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:42.225119 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f132d7c3-f91f-45c9-ae32-c98809a6efd5-cluster-monitoring-operator-tls podName:f132d7c3-f91f-45c9-ae32-c98809a6efd5 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:43.225106529 +0000 UTC m=+63.308399794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f132d7c3-f91f-45c9-ae32-c98809a6efd5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4ddqc" (UID: "f132d7c3-f91f-45c9-ae32-c98809a6efd5") : secret "cluster-monitoring-operator-tls" not found Jul 06 14:20:42.225151 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:42.225132 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-metrics-certs podName:0d6d9866-81db-423a-b0ff-75a455a72619 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:43.225126022 +0000 UTC m=+63.308419273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-metrics-certs") pod "router-default-5d778f859f-t8gjz" (UID: "0d6d9866-81db-423a-b0ff-75a455a72619") : secret "router-metrics-certs-default" not found Jul 06 14:20:42.665562 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:42.665502 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc" event={"ID":"b10bd373-75a4-47dc-9848-85868203da06","Type":"ContainerStarted","Data":"ded930475b9c156c212f662ddb4862667570dd03339538a0adfe69cf13aa390a"} Jul 06 14:20:42.666791 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:42.666762 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-d6v8z" event={"ID":"7af9649f-329f-4a61-b91b-964ec516a88b","Type":"ContainerStarted","Data":"64e1ea15b75f2b66f2011ce8a51d783ca2e333b79a3b8ba86043af3bb549c9e4"} Jul 06 14:20:43.074975 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:43.074938 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:43.177064 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:43.177015 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:43.232643 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:43.232618 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f132d7c3-f91f-45c9-ae32-c98809a6efd5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4ddqc\" (UID: \"f132d7c3-f91f-45c9-ae32-c98809a6efd5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" Jul 06 14:20:43.232755 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:43.232673 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6d9866-81db-423a-b0ff-75a455a72619-service-ca-bundle\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:43.232755 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:43.232739 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-metrics-certs\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:43.232856 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:43.232776 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 14:20:43.232856 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:43.232850 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f132d7c3-f91f-45c9-ae32-c98809a6efd5-cluster-monitoring-operator-tls podName:f132d7c3-f91f-45c9-ae32-c98809a6efd5 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:45.232830266 +0000 UTC m=+65.316123538 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f132d7c3-f91f-45c9-ae32-c98809a6efd5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4ddqc" (UID: "f132d7c3-f91f-45c9-ae32-c98809a6efd5") : secret "cluster-monitoring-operator-tls" not found Jul 06 14:20:43.232856 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:43.232852 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 14:20:43.232979 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:43.232881 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d6d9866-81db-423a-b0ff-75a455a72619-service-ca-bundle podName:0d6d9866-81db-423a-b0ff-75a455a72619 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:45.23285796 +0000 UTC m=+65.316151225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0d6d9866-81db-423a-b0ff-75a455a72619-service-ca-bundle") pod "router-default-5d778f859f-t8gjz" (UID: "0d6d9866-81db-423a-b0ff-75a455a72619") : configmap references non-existent config key: service-ca.crt Jul 06 14:20:43.232979 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:43.232908 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-metrics-certs podName:0d6d9866-81db-423a-b0ff-75a455a72619 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:45.232897568 +0000 UTC m=+65.316190825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-metrics-certs") pod "router-default-5d778f859f-t8gjz" (UID: "0d6d9866-81db-423a-b0ff-75a455a72619") : secret "router-metrics-certs-default" not found Jul 06 14:20:43.280327 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:43.280285 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:43.571130 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:43.571083 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:43.654786 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:43.654756 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:43.670737 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:43.670706 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-d6v8z" event={"ID":"7af9649f-329f-4a61-b91b-964ec516a88b","Type":"ContainerStarted","Data":"de44db37623986eea21dc1f3272f4cd247a3ae71a1eb4ce722b02289b142a59f"} Jul 06 14:20:43.692288 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:43.692237 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-d6v8z" podStartSLOduration=1.430383962 podStartE2EDuration="2.692221677s" totalImagesPullingTime="1.261837715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:43.690741696 +0000 UTC m=+63.774034969" watchObservedRunningTime="2026-07-06 14:20:43.692221677 +0000 UTC m=+63.775514950" Jul 06 14:20:43.860156 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:43.860049 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:43.960326 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:43.960284 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:44.676526 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:44.676493 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc" event={"ID":"b10bd373-75a4-47dc-9848-85868203da06","Type":"ContainerStarted","Data":"5bc909aa0e42ad7eb7bc8132d1024a872b65d8623dfabff525e48bb19fa7c41d"} Jul 06 14:20:44.697516 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:44.697460 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc" podStartSLOduration=1.1858989229999999 podStartE2EDuration="3.697443914s" totalImagesPullingTime="2.511544991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:44.696410025 +0000 UTC m=+64.779703299" watchObservedRunningTime="2026-07-06 14:20:44.697443914 +0000 UTC m=+64.780737186" Jul 06 14:20:45.250445 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:45.250406 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f132d7c3-f91f-45c9-ae32-c98809a6efd5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4ddqc\" (UID: \"f132d7c3-f91f-45c9-ae32-c98809a6efd5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" Jul 06 14:20:45.250651 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:45.250460 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6d9866-81db-423a-b0ff-75a455a72619-service-ca-bundle\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:45.250651 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:45.250516 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-metrics-certs\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:45.250651 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:45.250585 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 14:20:45.250651 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:45.250639 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 14:20:45.250791 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:45.250662 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f132d7c3-f91f-45c9-ae32-c98809a6efd5-cluster-monitoring-operator-tls podName:f132d7c3-f91f-45c9-ae32-c98809a6efd5 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:49.250641691 +0000 UTC m=+69.333934956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f132d7c3-f91f-45c9-ae32-c98809a6efd5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4ddqc" (UID: "f132d7c3-f91f-45c9-ae32-c98809a6efd5") : secret "cluster-monitoring-operator-tls" not found Jul 06 14:20:45.250791 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:45.250695 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-metrics-certs podName:0d6d9866-81db-423a-b0ff-75a455a72619 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:49.250673633 +0000 UTC m=+69.333966884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-metrics-certs") pod "router-default-5d778f859f-t8gjz" (UID: "0d6d9866-81db-423a-b0ff-75a455a72619") : secret "router-metrics-certs-default" not found Jul 06 14:20:45.250791 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:45.250712 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d6d9866-81db-423a-b0ff-75a455a72619-service-ca-bundle podName:0d6d9866-81db-423a-b0ff-75a455a72619 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:49.250703501 +0000 UTC m=+69.333996757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0d6d9866-81db-423a-b0ff-75a455a72619-service-ca-bundle") pod "router-default-5d778f859f-t8gjz" (UID: "0d6d9866-81db-423a-b0ff-75a455a72619") : configmap references non-existent config key: service-ca.crt Jul 06 14:20:45.556393 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:45.556362 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:45.637632 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:45.637465 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:46.020254 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.020174 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:46.105771 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.105732 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:46.258543 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.258501 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret\") pod \"global-pull-secret-syncer-78ldj\" (UID: \"5e1320b0-0f60-4ac3-9519-44b66306b3b1\") " pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:20:46.258758 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.258585 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs\") pod \"network-metrics-daemon-bsgjj\" (UID: \"a5c657bf-dc1b-41f9-b16d-7d4336abdd69\") " pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:20:46.265241 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.265205 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 14:20:46.265386 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.265272 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 14:20:46.269446 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:46.269427 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 14:20:46.269534 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:46.269489 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs podName:a5c657bf-dc1b-41f9-b16d-7d4336abdd69 nodeName:}" failed. No retries permitted until 2026-07-06 14:21:50.269472228 +0000 UTC m=+130.352765491 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs") pod "network-metrics-daemon-bsgjj" (UID: "a5c657bf-dc1b-41f9-b16d-7d4336abdd69") : secret "metrics-daemon-secret" not found Jul 06 14:20:46.271955 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.271905 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e1320b0-0f60-4ac3-9519-44b66306b3b1-original-pull-secret\") pod \"global-pull-secret-syncer-78ldj\" (UID: \"5e1320b0-0f60-4ac3-9519-44b66306b3b1\") " pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:20:46.319530 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.319496 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78ldj" Jul 06 14:20:46.320926 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.320898 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:46.359341 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.359305 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l5wz\" (UniqueName: \"kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz\") pod \"network-check-target-2krbh\" (UID: \"e332c7f3-e91d-4c1d-b29f-1568b2853493\") " pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:20:46.362608 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.362585 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 14:20:46.373313 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.373287 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 14:20:46.384108 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.384070 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l5wz\" (UniqueName: \"kubernetes.io/projected/e332c7f3-e91d-4c1d-b29f-1568b2853493-kube-api-access-4l5wz\") pod \"network-check-target-2krbh\" (UID: \"e332c7f3-e91d-4c1d-b29f-1568b2853493\") " pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:20:46.426032 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.426004 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:46.445472 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.445440 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-78ldj"] Jul 06 14:20:46.449264 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:20:46.449239 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e1320b0_0f60_4ac3_9519_44b66306b3b1.slice/crio-fd09ec939ef48701eb6e4e9bd04c663ea22141780d1c83a4558e575081cc6eeb WatchSource:0}: Error finding container fd09ec939ef48701eb6e4e9bd04c663ea22141780d1c83a4558e575081cc6eeb: Status 404 returned error can't find the container with id fd09ec939ef48701eb6e4e9bd04c663ea22141780d1c83a4558e575081cc6eeb Jul 06 14:20:46.643820 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.643791 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-74wbt\"" Jul 06 14:20:46.651265 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.651243 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:20:46.682982 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.682950 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-78ldj" event={"ID":"5e1320b0-0f60-4ac3-9519-44b66306b3b1","Type":"ContainerStarted","Data":"fd09ec939ef48701eb6e4e9bd04c663ea22141780d1c83a4558e575081cc6eeb"} Jul 06 14:20:46.782170 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:46.782003 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2krbh"] Jul 06 14:20:46.784609 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:20:46.784579 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode332c7f3_e91d_4c1d_b29f_1568b2853493.slice/crio-3a18621e749a30c00bb7d235f6ecebf3bfd582e15f2c692cc900c1b3674b82ad WatchSource:0}: Error finding container 3a18621e749a30c00bb7d235f6ecebf3bfd582e15f2c692cc900c1b3674b82ad: Status 404 returned error can't find the container with id 3a18621e749a30c00bb7d235f6ecebf3bfd582e15f2c692cc900c1b3674b82ad Jul 06 14:20:47.064585 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:47.064534 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:20:47.064960 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:47.064680 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:20:47.064960 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:47.064719 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 14:20:47.064960 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:47.064776 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 14:20:47.064960 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:47.064789 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d8849664b-8l2fw: secret "image-registry-tls" not found Jul 06 14:20:47.064960 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:47.064795 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls podName:237f8a8c-6481-4ffa-b117-9a00b63917e4 nodeName:}" failed. No retries permitted until 2026-07-06 14:21:19.06477517 +0000 UTC m=+99.148068438 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls") pod "dns-default-pwplc" (UID: "237f8a8c-6481-4ffa-b117-9a00b63917e4") : secret "dns-default-metrics-tls" not found Jul 06 14:20:47.064960 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:47.064821 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls podName:38aa2d4f-ea9a-487a-9f1e-b322547d81d3 nodeName:}" failed. No retries permitted until 2026-07-06 14:21:19.064812319 +0000 UTC m=+99.148105572 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls") pod "image-registry-7d8849664b-8l2fw" (UID: "38aa2d4f-ea9a-487a-9f1e-b322547d81d3") : secret "image-registry-tls" not found Jul 06 14:20:47.687407 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:47.687362 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2krbh" event={"ID":"e332c7f3-e91d-4c1d-b29f-1568b2853493","Type":"ContainerStarted","Data":"3a18621e749a30c00bb7d235f6ecebf3bfd582e15f2c692cc900c1b3674b82ad"} Jul 06 14:20:47.845681 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:47.845639 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:47.971058 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:47.970977 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:47.978911 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:47.978878 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-7s8jc"] Jul 06 14:20:48.001371 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.001328 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-7s8jc"] Jul 06 14:20:48.001533 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.001434 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-7s8jc" Jul 06 14:20:48.004815 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.004784 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 14:20:48.005229 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.005072 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jwf8s\"" Jul 06 14:20:48.006243 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.006039 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 14:20:48.006243 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.006061 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 14:20:48.006391 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.006359 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 14:20:48.073480 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.073443 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbt2x\" (UniqueName: \"kubernetes.io/projected/37d4cec8-1056-44e0-a25d-f58f5ac7a1d4-kube-api-access-nbt2x\") pod \"service-ca-758f599c5-7s8jc\" (UID: \"37d4cec8-1056-44e0-a25d-f58f5ac7a1d4\") " pod="openshift-service-ca/service-ca-758f599c5-7s8jc" Jul 06 14:20:48.073915 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.073497 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/37d4cec8-1056-44e0-a25d-f58f5ac7a1d4-signing-cabundle\") pod \"service-ca-758f599c5-7s8jc\" (UID: \"37d4cec8-1056-44e0-a25d-f58f5ac7a1d4\") " pod="openshift-service-ca/service-ca-758f599c5-7s8jc" Jul 06 14:20:48.073915 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.073531 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/37d4cec8-1056-44e0-a25d-f58f5ac7a1d4-signing-key\") pod \"service-ca-758f599c5-7s8jc\" (UID: \"37d4cec8-1056-44e0-a25d-f58f5ac7a1d4\") " pod="openshift-service-ca/service-ca-758f599c5-7s8jc" Jul 06 14:20:48.076236 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.076202 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:48.174599 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.174566 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbt2x\" (UniqueName: \"kubernetes.io/projected/37d4cec8-1056-44e0-a25d-f58f5ac7a1d4-kube-api-access-nbt2x\") pod \"service-ca-758f599c5-7s8jc\" (UID: \"37d4cec8-1056-44e0-a25d-f58f5ac7a1d4\") " pod="openshift-service-ca/service-ca-758f599c5-7s8jc" Jul 06 14:20:48.174599 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.174603 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/37d4cec8-1056-44e0-a25d-f58f5ac7a1d4-signing-cabundle\") pod \"service-ca-758f599c5-7s8jc\" (UID: \"37d4cec8-1056-44e0-a25d-f58f5ac7a1d4\") " pod="openshift-service-ca/service-ca-758f599c5-7s8jc" Jul 06 14:20:48.174877 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.174627 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/37d4cec8-1056-44e0-a25d-f58f5ac7a1d4-signing-key\") pod \"service-ca-758f599c5-7s8jc\" (UID: \"37d4cec8-1056-44e0-a25d-f58f5ac7a1d4\") " pod="openshift-service-ca/service-ca-758f599c5-7s8jc" Jul 06 14:20:48.175322 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.175295 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/37d4cec8-1056-44e0-a25d-f58f5ac7a1d4-signing-cabundle\") pod \"service-ca-758f599c5-7s8jc\" (UID: \"37d4cec8-1056-44e0-a25d-f58f5ac7a1d4\") " pod="openshift-service-ca/service-ca-758f599c5-7s8jc" Jul 06 14:20:48.177628 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.177599 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/37d4cec8-1056-44e0-a25d-f58f5ac7a1d4-signing-key\") pod \"service-ca-758f599c5-7s8jc\" (UID: \"37d4cec8-1056-44e0-a25d-f58f5ac7a1d4\") " pod="openshift-service-ca/service-ca-758f599c5-7s8jc" Jul 06 14:20:48.185244 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.185219 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbt2x\" (UniqueName: \"kubernetes.io/projected/37d4cec8-1056-44e0-a25d-f58f5ac7a1d4-kube-api-access-nbt2x\") pod \"service-ca-758f599c5-7s8jc\" (UID: \"37d4cec8-1056-44e0-a25d-f58f5ac7a1d4\") " pod="openshift-service-ca/service-ca-758f599c5-7s8jc" Jul 06 14:20:48.313853 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.313816 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-7s8jc" Jul 06 14:20:48.465670 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.465633 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-7s8jc"] Jul 06 14:20:48.470458 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:20:48.470431 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37d4cec8_1056_44e0_a25d_f58f5ac7a1d4.slice/crio-6cf963e9c233bb9b14badc1e6fd04f18b9cfa99a84cefeb30e98ea6c85b81002 WatchSource:0}: Error finding container 6cf963e9c233bb9b14badc1e6fd04f18b9cfa99a84cefeb30e98ea6c85b81002: Status 404 returned error can't find the container with id 6cf963e9c233bb9b14badc1e6fd04f18b9cfa99a84cefeb30e98ea6c85b81002 Jul 06 14:20:48.695726 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.695685 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-7s8jc" event={"ID":"37d4cec8-1056-44e0-a25d-f58f5ac7a1d4","Type":"ContainerStarted","Data":"7c70b40b5ac46e88c0fa238b2e2d06737d086973fd771ba096bd0a3dea682556"} Jul 06 14:20:48.695904 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.695780 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-7s8jc" event={"ID":"37d4cec8-1056-44e0-a25d-f58f5ac7a1d4","Type":"ContainerStarted","Data":"6cf963e9c233bb9b14badc1e6fd04f18b9cfa99a84cefeb30e98ea6c85b81002"} Jul 06 14:20:48.719741 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:48.719680 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-7s8jc" podStartSLOduration=1.71966036 podStartE2EDuration="1.71966036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:20:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:48.719491056 +0000 UTC m=+68.802784329" watchObservedRunningTime="2026-07-06 14:20:48.71966036 +0000 UTC m=+68.802953634" Jul 06 14:20:49.108066 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:49.108029 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:49.284419 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:49.284373 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-metrics-certs\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:49.284640 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:49.284447 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f132d7c3-f91f-45c9-ae32-c98809a6efd5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4ddqc\" (UID: \"f132d7c3-f91f-45c9-ae32-c98809a6efd5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" Jul 06 14:20:49.284640 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:49.284494 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6d9866-81db-423a-b0ff-75a455a72619-service-ca-bundle\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:49.284640 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:49.284510 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 14:20:49.284640 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:49.284595 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-metrics-certs podName:0d6d9866-81db-423a-b0ff-75a455a72619 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:57.284577203 +0000 UTC m=+77.367870471 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-metrics-certs") pod "router-default-5d778f859f-t8gjz" (UID: "0d6d9866-81db-423a-b0ff-75a455a72619") : secret "router-metrics-certs-default" not found Jul 06 14:20:49.284640 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:49.284628 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d6d9866-81db-423a-b0ff-75a455a72619-service-ca-bundle podName:0d6d9866-81db-423a-b0ff-75a455a72619 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:57.284617813 +0000 UTC m=+77.367911064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0d6d9866-81db-423a-b0ff-75a455a72619-service-ca-bundle") pod "router-default-5d778f859f-t8gjz" (UID: "0d6d9866-81db-423a-b0ff-75a455a72619") : configmap references non-existent config key: service-ca.crt Jul 06 14:20:49.284918 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:49.284696 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 14:20:49.284918 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:20:49.284766 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f132d7c3-f91f-45c9-ae32-c98809a6efd5-cluster-monitoring-operator-tls podName:f132d7c3-f91f-45c9-ae32-c98809a6efd5 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:57.284746509 +0000 UTC m=+77.368039774 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f132d7c3-f91f-45c9-ae32-c98809a6efd5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4ddqc" (UID: "f132d7c3-f91f-45c9-ae32-c98809a6efd5") : secret "cluster-monitoring-operator-tls" not found Jul 06 14:20:49.297818 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:49.297784 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:50.117445 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:50.117365 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:50.396936 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:50.396789 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:50.605157 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:50.605071 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:50.728617 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:50.728473 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:50.946471 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:50.946431 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:51.360890 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:51.360851 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:51.410050 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:51.410017 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gkrh4_2f5a6228-018c-4abe-b695-0be2d969f75f/dns-node-resolver/0.log" Jul 06 14:20:52.169936 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:52.169903 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:52.359473 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:52.359437 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:52.407967 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:52.407884 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wtlss_4ee272d2-a9a5-4bda-b04a-c0833b785412/node-ca/0.log" Jul 06 14:20:52.714463 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:52.714381 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-78ldj" event={"ID":"5e1320b0-0f60-4ac3-9519-44b66306b3b1","Type":"ContainerStarted","Data":"b7154e66d0c0de21440f5844ec95a1eaa6d36d5dab06f0933357e62ab4e8ecce"} Jul 06 14:20:52.716063 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:52.716037 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2krbh" event={"ID":"e332c7f3-e91d-4c1d-b29f-1568b2853493","Type":"ContainerStarted","Data":"71b4a5480e85c52d96200dbaeec3d13ba1914a4de18c92edb6cc283d431b10b8"} Jul 06 14:20:52.716176 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:52.716092 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:20:52.755967 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:52.755912 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-78ldj" podStartSLOduration=66.813000669 podStartE2EDuration="1m12.755896983s" totalImagesPullingTime="5.942896314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:52.735067236 +0000 UTC m=+72.818360519" watchObservedRunningTime="2026-07-06 14:20:52.755896983 +0000 UTC m=+72.839190255" Jul 06 14:20:52.769630 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:52.769597 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:52.876009 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:52.875970 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:52.960881 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:52.960842 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:53.009691 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:53.009618 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-546wb_5d751f46-4d3b-42b0-ae32-1215e09a5669/serve-healthcheck-canary/0.log" Jul 06 14:20:53.382381 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:53.382346 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:53.786882 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:53.786845 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:53.920894 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:53.920862 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:54.025821 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:54.025785 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:54.125070 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:54.124987 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:54.397385 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:54.397285 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:54.780192 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:54.780079 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:54.868898 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:54.868863 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:55.187799 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:55.187764 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:55.664951 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:55.664921 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:55.974945 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:55.974844 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:56.208304 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:56.208270 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:56.319575 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:56.319527 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:56.579943 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:56.579839 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:57.190443 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:57.190408 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:57.361494 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:57.361457 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-metrics-certs\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:57.361718 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:57.361511 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f132d7c3-f91f-45c9-ae32-c98809a6efd5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4ddqc\" (UID: \"f132d7c3-f91f-45c9-ae32-c98809a6efd5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" Jul 06 14:20:57.361718 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:57.361567 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6d9866-81db-423a-b0ff-75a455a72619-service-ca-bundle\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:57.362315 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:57.362231 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6d9866-81db-423a-b0ff-75a455a72619-service-ca-bundle\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:57.364222 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:57.364195 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d6d9866-81db-423a-b0ff-75a455a72619-metrics-certs\") pod \"router-default-5d778f859f-t8gjz\" (UID: \"0d6d9866-81db-423a-b0ff-75a455a72619\") " pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:57.364337 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:57.364195 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f132d7c3-f91f-45c9-ae32-c98809a6efd5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4ddqc\" (UID: \"f132d7c3-f91f-45c9-ae32-c98809a6efd5\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" Jul 06 14:20:57.415147 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:57.415114 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" Jul 06 14:20:57.422478 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:57.422449 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:57.563048 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:57.562979 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2krbh" podStartSLOduration=71.960362505 podStartE2EDuration="1m17.562956201s" totalImagesPullingTime="5.602593696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:52.755262626 +0000 UTC m=+72.838555909" watchObservedRunningTime="2026-07-06 14:20:57.562956201 +0000 UTC m=+77.646249476" Jul 06 14:20:57.563699 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:57.563675 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d778f859f-t8gjz"] Jul 06 14:20:57.567118 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:20:57.567082 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d6d9866_81db_423a_b0ff_75a455a72619.slice/crio-7c01a2603a78ea296c272a9349aea6b2c626b7f785850a8305290053cfbeebb5 WatchSource:0}: Error finding container 7c01a2603a78ea296c272a9349aea6b2c626b7f785850a8305290053cfbeebb5: Status 404 returned error can't find the container with id 7c01a2603a78ea296c272a9349aea6b2c626b7f785850a8305290053cfbeebb5 Jul 06 14:20:57.577016 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:57.576993 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc"] Jul 06 14:20:57.580102 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:20:57.580079 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf132d7c3_f91f_45c9_ae32_c98809a6efd5.slice/crio-8bb57c62c6030cecb3111a24b61dca4df5e4382fc87d398f23fdc90146c1a356 WatchSource:0}: Error finding container 8bb57c62c6030cecb3111a24b61dca4df5e4382fc87d398f23fdc90146c1a356: Status 404 returned error can't find the container with id 8bb57c62c6030cecb3111a24b61dca4df5e4382fc87d398f23fdc90146c1a356 Jul 06 14:20:57.733803 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:57.733705 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d778f859f-t8gjz" event={"ID":"0d6d9866-81db-423a-b0ff-75a455a72619","Type":"ContainerStarted","Data":"cf86c7b78bed3298c4d7401d7ae3fa7e34687605c73b6189a29b06b5f0ef8775"} Jul 06 14:20:57.733803 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:57.733769 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d778f859f-t8gjz" event={"ID":"0d6d9866-81db-423a-b0ff-75a455a72619","Type":"ContainerStarted","Data":"7c01a2603a78ea296c272a9349aea6b2c626b7f785850a8305290053cfbeebb5"} Jul 06 14:20:57.734927 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:57.734904 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" event={"ID":"f132d7c3-f91f-45c9-ae32-c98809a6efd5","Type":"ContainerStarted","Data":"8bb57c62c6030cecb3111a24b61dca4df5e4382fc87d398f23fdc90146c1a356"} Jul 06 14:20:57.765811 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:57.765743 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5d778f859f-t8gjz" podStartSLOduration=16.765724545 podStartE2EDuration="16.765724545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:20:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:57.765039299 +0000 UTC m=+77.848332585" watchObservedRunningTime="2026-07-06 14:20:57.765724545 +0000 UTC m=+77.849017819" Jul 06 14:20:57.778098 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:57.778066 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:58.040870 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:58.040838 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:58.215835 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:58.215798 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:58.423275 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:58.423184 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:58.426306 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:58.426281 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:58.474073 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:58.474021 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:58.738142 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:58.738064 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:58.739413 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:58.739394 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5d778f859f-t8gjz" Jul 06 14:20:59.206606 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:59.206538 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:59.362465 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:59.362425 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:59.561642 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:59.561603 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:20:59.742783 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:59.742741 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" event={"ID":"f132d7c3-f91f-45c9-ae32-c98809a6efd5","Type":"ContainerStarted","Data":"8555e2cf4aa456f340efd2130f1be34a5569258eba12a7aba882fb0c577cc176"} Jul 06 14:20:59.783036 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:59.782988 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4ddqc" podStartSLOduration=16.779207058 podStartE2EDuration="18.782969503s" totalImagesPullingTime="2.003762445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:59.781144265 +0000 UTC m=+79.864437538" watchObservedRunningTime="2026-07-06 14:20:59.782969503 +0000 UTC m=+79.866262806" Jul 06 14:20:59.802787 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:20:59.802752 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:00.062195 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:00.062165 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:00.215935 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:00.215894 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:00.314756 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:00.314655 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:00.584392 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:00.584296 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:00.987591 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:00.987474 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:01.157529 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:01.157490 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:01.244755 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:01.244659 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:02.799894 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:02.799772 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:02.885040 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:02.884997 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:05.210377 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:05.210326 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:05.312579 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:05.312511 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:05.383116 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:05.383060 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:05.499069 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:05.498976 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:05.905912 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:05.905867 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:05.999796 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:05.999763 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:06.277825 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:06.277653 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:06.378634 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:06.378596 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:06.894453 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:06.894416 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:07.050501 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:07.050450 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:07.164175 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:07.164076 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:07.297388 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:07.297351 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:08.119129 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:08.119097 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:08.199309 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:08.199264 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:11.977935 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:11.977904 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vcw5v"] Jul 06 14:21:11.981203 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:11.981187 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vcw5v" Jul 06 14:21:11.983993 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:11.983974 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 14:21:11.985004 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:11.984986 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 14:21:11.985058 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:11.984991 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nzwtp\"" Jul 06 14:21:11.985058 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:11.985048 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 14:21:11.985499 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:11.985481 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 14:21:11.999297 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:11.999276 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vcw5v"] Jul 06 14:21:12.079535 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.079502 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb"] Jul 06 14:21:12.082453 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.082426 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz4fq\" (UniqueName: \"kubernetes.io/projected/abc744a8-ca28-4c7a-92e1-9d95de8b4b61-kube-api-access-gz4fq\") pod \"insights-runtime-extractor-vcw5v\" (UID: \"abc744a8-ca28-4c7a-92e1-9d95de8b4b61\") " pod="openshift-insights/insights-runtime-extractor-vcw5v" Jul 06 14:21:12.082610 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.082465 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/abc744a8-ca28-4c7a-92e1-9d95de8b4b61-crio-socket\") pod \"insights-runtime-extractor-vcw5v\" (UID: \"abc744a8-ca28-4c7a-92e1-9d95de8b4b61\") " pod="openshift-insights/insights-runtime-extractor-vcw5v" Jul 06 14:21:12.082610 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.082593 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/abc744a8-ca28-4c7a-92e1-9d95de8b4b61-data-volume\") pod \"insights-runtime-extractor-vcw5v\" (UID: \"abc744a8-ca28-4c7a-92e1-9d95de8b4b61\") " pod="openshift-insights/insights-runtime-extractor-vcw5v" Jul 06 14:21:12.082715 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.082647 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs"] Jul 06 14:21:12.082715 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.082638 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abc744a8-ca28-4c7a-92e1-9d95de8b4b61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcw5v\" (UID: \"abc744a8-ca28-4c7a-92e1-9d95de8b4b61\") " pod="openshift-insights/insights-runtime-extractor-vcw5v" Jul 06 14:21:12.082875 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.082855 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abc744a8-ca28-4c7a-92e1-9d95de8b4b61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcw5v\" (UID: \"abc744a8-ca28-4c7a-92e1-9d95de8b4b61\") " pod="openshift-insights/insights-runtime-extractor-vcw5v" Jul 06 14:21:12.082916 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.082881 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb" Jul 06 14:21:12.085806 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.085787 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs" Jul 06 14:21:12.087258 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.087201 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 14:21:12.087897 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.087617 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 14:21:12.087897 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.087655 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 14:21:12.087897 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.087677 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 06 14:21:12.088493 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.088468 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 06 14:21:12.089275 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.088959 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-gw7zj\"" Jul 06 14:21:12.089275 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.088960 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:12.104804 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.104779 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb"] Jul 06 14:21:12.105882 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.105861 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs"] Jul 06 14:21:12.184197 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.184158 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abc744a8-ca28-4c7a-92e1-9d95de8b4b61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcw5v\" (UID: \"abc744a8-ca28-4c7a-92e1-9d95de8b4b61\") " pod="openshift-insights/insights-runtime-extractor-vcw5v" Jul 06 14:21:12.184197 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.184194 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ac36675-dd8f-45ca-8ceb-e14251ee5c5a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs\" (UID: \"5ac36675-dd8f-45ca-8ceb-e14251ee5c5a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs" Jul 06 14:21:12.184433 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.184214 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6b7bb0b-aed8-476d-84b6-f5d07ce47978-tmp\") pod \"klusterlet-addon-workmgr-86d6999654-svxqb\" (UID: \"e6b7bb0b-aed8-476d-84b6-f5d07ce47978\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb" Jul 06 14:21:12.184433 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.184250 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gssz4\" (UniqueName: \"kubernetes.io/projected/5ac36675-dd8f-45ca-8ceb-e14251ee5c5a-kube-api-access-gssz4\") pod \"managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs\" (UID: \"5ac36675-dd8f-45ca-8ceb-e14251ee5c5a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs" Jul 06 14:21:12.184433 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.184339 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz4fq\" (UniqueName: \"kubernetes.io/projected/abc744a8-ca28-4c7a-92e1-9d95de8b4b61-kube-api-access-gz4fq\") pod \"insights-runtime-extractor-vcw5v\" (UID: \"abc744a8-ca28-4c7a-92e1-9d95de8b4b61\") " pod="openshift-insights/insights-runtime-extractor-vcw5v" Jul 06 14:21:12.184433 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.184362 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/abc744a8-ca28-4c7a-92e1-9d95de8b4b61-crio-socket\") pod \"insights-runtime-extractor-vcw5v\" (UID: \"abc744a8-ca28-4c7a-92e1-9d95de8b4b61\") " pod="openshift-insights/insights-runtime-extractor-vcw5v" Jul 06 14:21:12.184433 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.184384 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4rxs\" (UniqueName: \"kubernetes.io/projected/e6b7bb0b-aed8-476d-84b6-f5d07ce47978-kube-api-access-h4rxs\") pod \"klusterlet-addon-workmgr-86d6999654-svxqb\" (UID: \"e6b7bb0b-aed8-476d-84b6-f5d07ce47978\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb" Jul 06 14:21:12.184433 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.184413 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e6b7bb0b-aed8-476d-84b6-f5d07ce47978-klusterlet-config\") pod \"klusterlet-addon-workmgr-86d6999654-svxqb\" (UID: \"e6b7bb0b-aed8-476d-84b6-f5d07ce47978\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb" Jul 06 14:21:12.184757 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.184456 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/abc744a8-ca28-4c7a-92e1-9d95de8b4b61-data-volume\") pod \"insights-runtime-extractor-vcw5v\" (UID: \"abc744a8-ca28-4c7a-92e1-9d95de8b4b61\") " pod="openshift-insights/insights-runtime-extractor-vcw5v" Jul 06 14:21:12.184757 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.184477 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/abc744a8-ca28-4c7a-92e1-9d95de8b4b61-crio-socket\") pod \"insights-runtime-extractor-vcw5v\" (UID: \"abc744a8-ca28-4c7a-92e1-9d95de8b4b61\") " pod="openshift-insights/insights-runtime-extractor-vcw5v" Jul 06 14:21:12.184757 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.184494 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abc744a8-ca28-4c7a-92e1-9d95de8b4b61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcw5v\" (UID: \"abc744a8-ca28-4c7a-92e1-9d95de8b4b61\") " pod="openshift-insights/insights-runtime-extractor-vcw5v" Jul 06 14:21:12.184886 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.184820 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/abc744a8-ca28-4c7a-92e1-9d95de8b4b61-data-volume\") pod \"insights-runtime-extractor-vcw5v\" (UID: \"abc744a8-ca28-4c7a-92e1-9d95de8b4b61\") " pod="openshift-insights/insights-runtime-extractor-vcw5v" Jul 06 14:21:12.185028 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.185012 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abc744a8-ca28-4c7a-92e1-9d95de8b4b61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcw5v\" (UID: \"abc744a8-ca28-4c7a-92e1-9d95de8b4b61\") " pod="openshift-insights/insights-runtime-extractor-vcw5v" Jul 06 14:21:12.186794 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.186765 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abc744a8-ca28-4c7a-92e1-9d95de8b4b61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcw5v\" (UID: \"abc744a8-ca28-4c7a-92e1-9d95de8b4b61\") " pod="openshift-insights/insights-runtime-extractor-vcw5v" Jul 06 14:21:12.216625 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.216595 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz4fq\" (UniqueName: \"kubernetes.io/projected/abc744a8-ca28-4c7a-92e1-9d95de8b4b61-kube-api-access-gz4fq\") pod \"insights-runtime-extractor-vcw5v\" (UID: \"abc744a8-ca28-4c7a-92e1-9d95de8b4b61\") " pod="openshift-insights/insights-runtime-extractor-vcw5v" Jul 06 14:21:12.231868 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.231799 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:12.284901 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.284868 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e6b7bb0b-aed8-476d-84b6-f5d07ce47978-klusterlet-config\") pod \"klusterlet-addon-workmgr-86d6999654-svxqb\" (UID: \"e6b7bb0b-aed8-476d-84b6-f5d07ce47978\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb" Jul 06 14:21:12.285078 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.284910 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ac36675-dd8f-45ca-8ceb-e14251ee5c5a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs\" (UID: \"5ac36675-dd8f-45ca-8ceb-e14251ee5c5a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs" Jul 06 14:21:12.285078 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.284938 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6b7bb0b-aed8-476d-84b6-f5d07ce47978-tmp\") pod \"klusterlet-addon-workmgr-86d6999654-svxqb\" (UID: \"e6b7bb0b-aed8-476d-84b6-f5d07ce47978\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb" Jul 06 14:21:12.285078 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.284980 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gssz4\" (UniqueName: \"kubernetes.io/projected/5ac36675-dd8f-45ca-8ceb-e14251ee5c5a-kube-api-access-gssz4\") pod \"managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs\" (UID: \"5ac36675-dd8f-45ca-8ceb-e14251ee5c5a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs" Jul 06 14:21:12.285189 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.285164 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4rxs\" (UniqueName: \"kubernetes.io/projected/e6b7bb0b-aed8-476d-84b6-f5d07ce47978-kube-api-access-h4rxs\") pod \"klusterlet-addon-workmgr-86d6999654-svxqb\" (UID: \"e6b7bb0b-aed8-476d-84b6-f5d07ce47978\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb" Jul 06 14:21:12.285420 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.285387 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6b7bb0b-aed8-476d-84b6-f5d07ce47978-tmp\") pod \"klusterlet-addon-workmgr-86d6999654-svxqb\" (UID: \"e6b7bb0b-aed8-476d-84b6-f5d07ce47978\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb" Jul 06 14:21:12.287640 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.287622 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ac36675-dd8f-45ca-8ceb-e14251ee5c5a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs\" (UID: \"5ac36675-dd8f-45ca-8ceb-e14251ee5c5a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs" Jul 06 14:21:12.287714 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.287694 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e6b7bb0b-aed8-476d-84b6-f5d07ce47978-klusterlet-config\") pod \"klusterlet-addon-workmgr-86d6999654-svxqb\" (UID: \"e6b7bb0b-aed8-476d-84b6-f5d07ce47978\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb" Jul 06 14:21:12.289466 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.289448 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vcw5v" Jul 06 14:21:12.314324 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.314294 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4rxs\" (UniqueName: \"kubernetes.io/projected/e6b7bb0b-aed8-476d-84b6-f5d07ce47978-kube-api-access-h4rxs\") pod \"klusterlet-addon-workmgr-86d6999654-svxqb\" (UID: \"e6b7bb0b-aed8-476d-84b6-f5d07ce47978\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb" Jul 06 14:21:12.321080 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.321050 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gssz4\" (UniqueName: \"kubernetes.io/projected/5ac36675-dd8f-45ca-8ceb-e14251ee5c5a-kube-api-access-gssz4\") pod \"managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs\" (UID: \"5ac36675-dd8f-45ca-8ceb-e14251ee5c5a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs" Jul 06 14:21:12.370279 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.370216 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:12.395126 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.395094 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb" Jul 06 14:21:12.406295 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.406269 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs" Jul 06 14:21:12.431914 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.431883 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vcw5v"] Jul 06 14:21:12.436014 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:21:12.435976 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc744a8_ca28_4c7a_92e1_9d95de8b4b61.slice/crio-59150294b57383d7ad686799d498143c4b8d10d1c8ef704b60fd549ba7f69a05 WatchSource:0}: Error finding container 59150294b57383d7ad686799d498143c4b8d10d1c8ef704b60fd549ba7f69a05: Status 404 returned error can't find the container with id 59150294b57383d7ad686799d498143c4b8d10d1c8ef704b60fd549ba7f69a05 Jul 06 14:21:12.579440 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.579414 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb"] Jul 06 14:21:12.580851 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:21:12.580815 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b7bb0b_aed8_476d_84b6_f5d07ce47978.slice/crio-92adf9f8be62e8f20852cbfe57d0cba00b92e3f6320f9ef9bcd87f5017ca1468 WatchSource:0}: Error finding container 92adf9f8be62e8f20852cbfe57d0cba00b92e3f6320f9ef9bcd87f5017ca1468: Status 404 returned error can't find the container with id 92adf9f8be62e8f20852cbfe57d0cba00b92e3f6320f9ef9bcd87f5017ca1468 Jul 06 14:21:12.598338 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.598312 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs"] Jul 06 14:21:12.601350 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:21:12.601326 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ac36675_dd8f_45ca_8ceb_e14251ee5c5a.slice/crio-1519342ba3cb567a672d769fee29badf5d9ba6c69551d66e646a97d2f7b06dcc WatchSource:0}: Error finding container 1519342ba3cb567a672d769fee29badf5d9ba6c69551d66e646a97d2f7b06dcc: Status 404 returned error can't find the container with id 1519342ba3cb567a672d769fee29badf5d9ba6c69551d66e646a97d2f7b06dcc Jul 06 14:21:12.780020 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.779937 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcw5v" event={"ID":"abc744a8-ca28-4c7a-92e1-9d95de8b4b61","Type":"ContainerStarted","Data":"59150294b57383d7ad686799d498143c4b8d10d1c8ef704b60fd549ba7f69a05"} Jul 06 14:21:12.781148 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.781117 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb" event={"ID":"e6b7bb0b-aed8-476d-84b6-f5d07ce47978","Type":"ContainerStarted","Data":"92adf9f8be62e8f20852cbfe57d0cba00b92e3f6320f9ef9bcd87f5017ca1468"} Jul 06 14:21:12.782221 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:12.782200 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs" event={"ID":"5ac36675-dd8f-45ca-8ceb-e14251ee5c5a","Type":"ContainerStarted","Data":"1519342ba3cb567a672d769fee29badf5d9ba6c69551d66e646a97d2f7b06dcc"} Jul 06 14:21:13.408323 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:13.408289 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:13.508561 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:13.508427 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:19.147371 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.147323 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:21:19.147890 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.147408 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:21:19.149878 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.149850 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/237f8a8c-6481-4ffa-b117-9a00b63917e4-metrics-tls\") pod \"dns-default-pwplc\" (UID: \"237f8a8c-6481-4ffa-b117-9a00b63917e4\") " pod="openshift-dns/dns-default-pwplc" Jul 06 14:21:19.150031 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.150012 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls\") pod \"image-registry-7d8849664b-8l2fw\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:21:19.375702 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.375668 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xn2mh\"" Jul 06 14:21:19.383467 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.383446 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:21:19.404111 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.404047 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tng92\"" Jul 06 14:21:19.411851 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.411829 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pwplc" Jul 06 14:21:19.520246 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.520214 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:19.566446 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.566417 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d8849664b-8l2fw"] Jul 06 14:21:19.569644 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:21:19.569616 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38aa2d4f_ea9a_487a_9f1e_b322547d81d3.slice/crio-e7def2fab4519f36665244eb9dc597fc2d247156bffe12d6cc85c0ab8dd7b7e7 WatchSource:0}: Error finding container e7def2fab4519f36665244eb9dc597fc2d247156bffe12d6cc85c0ab8dd7b7e7: Status 404 returned error can't find the container with id e7def2fab4519f36665244eb9dc597fc2d247156bffe12d6cc85c0ab8dd7b7e7 Jul 06 14:21:19.573349 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.573323 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pwplc"] Jul 06 14:21:19.576155 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:21:19.576134 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod237f8a8c_6481_4ffa_b117_9a00b63917e4.slice/crio-199cea6b1632db127a5362bade01f9fbf0fe0e68704dae87e8781f798d73bf95 WatchSource:0}: Error finding container 199cea6b1632db127a5362bade01f9fbf0fe0e68704dae87e8781f798d73bf95: Status 404 returned error can't find the container with id 199cea6b1632db127a5362bade01f9fbf0fe0e68704dae87e8781f798d73bf95 Jul 06 14:21:19.619604 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.619574 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:19.813601 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.813559 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb" event={"ID":"e6b7bb0b-aed8-476d-84b6-f5d07ce47978","Type":"ContainerStarted","Data":"a32b41097e445f70c59abf13e76906858a90c265d2015c6fef2c8a2ab2a92c32"} Jul 06 14:21:19.813810 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.813745 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb" Jul 06 14:21:19.815185 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.815156 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" event={"ID":"38aa2d4f-ea9a-487a-9f1e-b322547d81d3","Type":"ContainerStarted","Data":"923391f9be08b5cc7ce41de5abd3e990968aef05488bcfffd000f5ddc4f6dd0c"} Jul 06 14:21:19.815326 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.815228 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:21:19.815326 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.815254 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" event={"ID":"38aa2d4f-ea9a-487a-9f1e-b322547d81d3","Type":"ContainerStarted","Data":"e7def2fab4519f36665244eb9dc597fc2d247156bffe12d6cc85c0ab8dd7b7e7"} Jul 06 14:21:19.815974 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.815945 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb" Jul 06 14:21:19.816496 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.816473 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pwplc" event={"ID":"237f8a8c-6481-4ffa-b117-9a00b63917e4","Type":"ContainerStarted","Data":"199cea6b1632db127a5362bade01f9fbf0fe0e68704dae87e8781f798d73bf95"} Jul 06 14:21:19.817959 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.817939 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs" event={"ID":"5ac36675-dd8f-45ca-8ceb-e14251ee5c5a","Type":"ContainerStarted","Data":"1df6ce4f9c6b0ae07566d929c33bcedc7b488d4694b2e4f5b59e55f79f51cda7"} Jul 06 14:21:19.819675 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.819654 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcw5v" event={"ID":"abc744a8-ca28-4c7a-92e1-9d95de8b4b61","Type":"ContainerStarted","Data":"7e655341e813df62d67a8babade6df202691a1e0ef034eadb4d7e6ef7a4ab31a"} Jul 06 14:21:19.819770 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.819703 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcw5v" event={"ID":"abc744a8-ca28-4c7a-92e1-9d95de8b4b61","Type":"ContainerStarted","Data":"b4e3ecf16e0600f74a9079acaf74089a6db55604eb39e0b7406fcbb86fb40f17"} Jul 06 14:21:19.837871 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.837817 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86d6999654-svxqb" podStartSLOduration=1.653769918 podStartE2EDuration="7.837803661s" totalImagesPullingTime="6.184033743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:19.835678971 +0000 UTC m=+99.918972244" watchObservedRunningTime="2026-07-06 14:21:19.837803661 +0000 UTC m=+99.921096933" Jul 06 14:21:19.876184 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.876125 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" podStartSLOduration=100.876106042 podStartE2EDuration="1m40.876106042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:19:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:19.875134832 +0000 UTC m=+99.958428104" watchObservedRunningTime="2026-07-06 14:21:19.876106042 +0000 UTC m=+99.959399316" Jul 06 14:21:19.893146 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:19.893069 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c5954b8b6-r7dhs" podStartSLOduration=1.752639831 podStartE2EDuration="7.893043847s" totalImagesPullingTime="6.140404016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:19.891734038 +0000 UTC m=+99.975027310" watchObservedRunningTime="2026-07-06 14:21:19.893043847 +0000 UTC m=+99.976337120" Jul 06 14:21:20.878390 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:20.878301 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:20.978819 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:20.978773 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:21.086354 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:21.086311 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:21.191050 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:21.190969 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:21.302504 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:21.302465 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:21.418837 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:21.418795 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:21.758537 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:21.758504 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:22.941293 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:22.941265 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:23.084209 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:23.084142 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:23.721998 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:23.721968 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2krbh" Jul 06 14:21:23.836446 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:23.836405 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pwplc" event={"ID":"237f8a8c-6481-4ffa-b117-9a00b63917e4","Type":"ContainerStarted","Data":"17e6a7c8c61a536e7c30b099873583c96441022fbdc665b3bf5106eaf4631c9b"} Jul 06 14:21:23.836667 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:23.836464 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pwplc" event={"ID":"237f8a8c-6481-4ffa-b117-9a00b63917e4","Type":"ContainerStarted","Data":"54e3e7f4e72508a88276c259d0294c702fc06645fba083269b3e72bc78b89f0d"} Jul 06 14:21:23.836667 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:23.836495 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pwplc" Jul 06 14:21:23.838511 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:23.838485 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcw5v" event={"ID":"abc744a8-ca28-4c7a-92e1-9d95de8b4b61","Type":"ContainerStarted","Data":"8a0ecc1bd3abe721470b5a48930abe6e65fa0165075b50c4dfd9173f06b69541"} Jul 06 14:21:23.858198 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:23.858149 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pwplc" podStartSLOduration=65.579896123 podStartE2EDuration="1m8.858134178s" totalImagesPullingTime="3.278238055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:20:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:23.857078269 +0000 UTC m=+103.940371541" watchObservedRunningTime="2026-07-06 14:21:23.858134178 +0000 UTC m=+103.941427451" Jul 06 14:21:23.881252 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:23.881201 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vcw5v" podStartSLOduration=2.59614765 podStartE2EDuration="12.881186312s" totalImagesPullingTime="10.285038662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:21:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:23.880120274 +0000 UTC m=+103.963413547" watchObservedRunningTime="2026-07-06 14:21:23.881186312 +0000 UTC m=+103.964479624" Jul 06 14:21:24.617321 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:24.617292 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:26.493116 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.493082 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:26.703067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.703032 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:26.781096 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.781011 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ddfxn"] Jul 06 14:21:26.785962 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.785941 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:26.788355 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.788330 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 14:21:26.788634 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.788615 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 14:21:26.788920 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.788899 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 14:21:26.789569 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.789534 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 14:21:26.789905 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.789888 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z62w8\"" Jul 06 14:21:26.791154 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.791127 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:26.872887 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.872851 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:26.911685 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.911653 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-sys\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:26.911894 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.911697 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-node-exporter-accelerators-collector-config\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:26.911894 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.911804 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-node-exporter-textfile\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:26.911894 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.911842 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jkmr\" (UniqueName: \"kubernetes.io/projected/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-kube-api-access-4jkmr\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:26.911894 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.911876 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-node-exporter-wtmp\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:26.912097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.911903 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-root\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:26.912097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.911928 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-metrics-client-ca\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:26.912097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.911959 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-node-exporter-tls\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:26.912097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.911981 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:26.973615 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:26.973534 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:27.012732 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.012702 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-metrics-client-ca\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.012917 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.012741 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-node-exporter-tls\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.012917 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.012767 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.012917 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.012809 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-sys\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.012917 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.012861 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-sys\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.013108 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.012987 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-node-exporter-accelerators-collector-config\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.013446 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.013421 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-metrics-client-ca\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.013706 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.013686 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-node-exporter-textfile\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.013833 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.013686 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-node-exporter-accelerators-collector-config\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.013833 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.013087 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-node-exporter-textfile\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.014019 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.013887 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jkmr\" (UniqueName: \"kubernetes.io/projected/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-kube-api-access-4jkmr\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.014019 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.013925 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-node-exporter-wtmp\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.014019 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.013954 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-root\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.014164 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.014029 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-root\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.014164 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.014129 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-node-exporter-wtmp\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.015538 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.015518 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-node-exporter-tls\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.015695 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.015676 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.025506 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.025483 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jkmr\" (UniqueName: \"kubernetes.io/projected/2d6d3115-6b26-4ba3-aaf9-51b92a24d434-kube-api-access-4jkmr\") pod \"node-exporter-ddfxn\" (UID: \"2d6d3115-6b26-4ba3-aaf9-51b92a24d434\") " pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.074519 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.074427 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:27.097315 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.097288 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ddfxn" Jul 06 14:21:27.109673 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:21:27.109641 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6d3115_6b26_4ba3_aaf9_51b92a24d434.slice/crio-3bdaac49f4d22a2b9944ba6e6851bc768c979c50421545fa5fc4694d20a1372a WatchSource:0}: Error finding container 3bdaac49f4d22a2b9944ba6e6851bc768c979c50421545fa5fc4694d20a1372a: Status 404 returned error can't find the container with id 3bdaac49f4d22a2b9944ba6e6851bc768c979c50421545fa5fc4694d20a1372a Jul 06 14:21:27.177143 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.177053 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:27.276568 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.276515 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:27.375877 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.375781 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:27.771193 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.771106 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:27.857990 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.857946 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:27.859215 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:27.859175 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ddfxn" event={"ID":"2d6d3115-6b26-4ba3-aaf9-51b92a24d434","Type":"ContainerStarted","Data":"3bdaac49f4d22a2b9944ba6e6851bc768c979c50421545fa5fc4694d20a1372a"} Jul 06 14:21:28.193089 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:28.193046 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:28.265359 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:28.265318 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:28.429868 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:28.429835 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:28.766539 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:28.766482 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:28.864473 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:28.864440 2582 generic.go:356] "Generic (PLEG): container finished" podID="2d6d3115-6b26-4ba3-aaf9-51b92a24d434" containerID="47c46feffa16478476c1e32ad1dcb9ca0b6a13bc79839a4171268647c113133b" exitCode=0 Jul 06 14:21:28.864913 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:28.864523 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ddfxn" event={"ID":"2d6d3115-6b26-4ba3-aaf9-51b92a24d434","Type":"ContainerDied","Data":"47c46feffa16478476c1e32ad1dcb9ca0b6a13bc79839a4171268647c113133b"} Jul 06 14:21:28.870406 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:28.870380 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:29.778284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:29.778234 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:29.868157 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:29.868124 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:29.871014 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:29.870979 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ddfxn" event={"ID":"2d6d3115-6b26-4ba3-aaf9-51b92a24d434","Type":"ContainerStarted","Data":"043cc79b116f5448399519162bb19960673ebf35c1f448460827380b00776bfd"} Jul 06 14:21:29.871143 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:29.871077 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ddfxn" event={"ID":"2d6d3115-6b26-4ba3-aaf9-51b92a24d434","Type":"ContainerStarted","Data":"d82d3ee8a162fb9effdb72183c1dde22353bc1ab69a8e25c766f96d37c77f11e"} Jul 06 14:21:29.898686 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:29.898634 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ddfxn" podStartSLOduration=2.656742505 podStartE2EDuration="3.89861981s" totalImagesPullingTime="1.172102803s" totalInitContainerRuntime="69.774502ms" isStatefulPod=true podCreationTimestamp="2026-07-06 14:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:29.897112782 +0000 UTC m=+109.980406059" watchObservedRunningTime="2026-07-06 14:21:29.89861981 +0000 UTC m=+109.981913082" Jul 06 14:21:29.973540 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:29.973506 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:30.515616 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:30.515527 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:31.546322 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:31.546282 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:31.616684 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:31.616652 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:31.783828 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:31.783780 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:32.745569 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:32.745521 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:32.847489 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:32.847462 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:33.117819 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:33.117777 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:33.848475 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:33.848447 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pwplc" Jul 06 14:21:35.735462 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:35.735423 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d8849664b-8l2fw"] Jul 06 14:21:35.739785 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:35.739756 2582 patch_prober.go:28] interesting pod/image-registry-7d8849664b-8l2fw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 14:21:35.739957 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:35.739808 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" podUID="38aa2d4f-ea9a-487a-9f1e-b322547d81d3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 14:21:35.845110 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:35.845055 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:35.945746 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:35.945714 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:36.780699 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:36.780662 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:36.882919 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:36.882886 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:38.044298 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.044260 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c8dd4dc49-24mk7"] Jul 06 14:21:38.047377 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.047360 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.050244 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.050217 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 14:21:38.050381 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.050223 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 14:21:38.051581 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.051415 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 14:21:38.051581 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.051450 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 14:21:38.051581 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.051450 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 14:21:38.051581 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.051433 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 14:21:38.051874 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.051859 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 14:21:38.052680 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.052657 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q962d\"" Jul 06 14:21:38.060473 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.060449 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 14:21:38.061873 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.061852 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c8dd4dc49-24mk7"] Jul 06 14:21:38.091323 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.091297 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-console-config\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.091323 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.091326 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-service-ca\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.091529 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.091360 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-trusted-ca-bundle\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.091529 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.091416 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-oauth-serving-cert\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.091529 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.091437 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/015d7cb1-4e59-4e4e-b881-57a49dc26971-console-serving-cert\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.091529 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.091453 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd9gx\" (UniqueName: \"kubernetes.io/projected/015d7cb1-4e59-4e4e-b881-57a49dc26971-kube-api-access-cd9gx\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.091529 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.091480 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/015d7cb1-4e59-4e4e-b881-57a49dc26971-console-oauth-config\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.192787 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.192753 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-oauth-serving-cert\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.192787 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.192795 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/015d7cb1-4e59-4e4e-b881-57a49dc26971-console-serving-cert\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.193029 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.192811 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd9gx\" (UniqueName: \"kubernetes.io/projected/015d7cb1-4e59-4e4e-b881-57a49dc26971-kube-api-access-cd9gx\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.193029 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.192827 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/015d7cb1-4e59-4e4e-b881-57a49dc26971-console-oauth-config\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.193029 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.192870 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-console-config\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.193029 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.192888 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-service-ca\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.193029 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.192926 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-trusted-ca-bundle\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.193584 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.193535 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-oauth-serving-cert\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.193702 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.193632 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-console-config\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.193887 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.193857 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-service-ca\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.194165 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.194140 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-trusted-ca-bundle\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.195586 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.195563 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/015d7cb1-4e59-4e4e-b881-57a49dc26971-console-oauth-config\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.195676 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.195657 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/015d7cb1-4e59-4e4e-b881-57a49dc26971-console-serving-cert\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.201647 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.201619 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd9gx\" (UniqueName: \"kubernetes.io/projected/015d7cb1-4e59-4e4e-b881-57a49dc26971-kube-api-access-cd9gx\") pod \"console-7c8dd4dc49-24mk7\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.357801 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.357705 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:38.494084 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.494052 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c8dd4dc49-24mk7"] Jul 06 14:21:38.498017 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:21:38.497992 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod015d7cb1_4e59_4e4e_b881_57a49dc26971.slice/crio-2adfa0574e45b3fd32694854fcd6cde4398a1d9228d74841bc477ae88d2d9f48 WatchSource:0}: Error finding container 2adfa0574e45b3fd32694854fcd6cde4398a1d9228d74841bc477ae88d2d9f48: Status 404 returned error can't find the container with id 2adfa0574e45b3fd32694854fcd6cde4398a1d9228d74841bc477ae88d2d9f48 Jul 06 14:21:38.905004 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:38.904972 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8dd4dc49-24mk7" event={"ID":"015d7cb1-4e59-4e4e-b881-57a49dc26971","Type":"ContainerStarted","Data":"2adfa0574e45b3fd32694854fcd6cde4398a1d9228d74841bc477ae88d2d9f48"} Jul 06 14:21:40.183763 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:40.183721 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:40.262600 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:40.262562 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:40.881003 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:40.880826 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:41.039443 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:41.039407 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:41.141661 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:41.141572 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:42.920059 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:42.920021 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8dd4dc49-24mk7" event={"ID":"015d7cb1-4e59-4e4e-b881-57a49dc26971","Type":"ContainerStarted","Data":"15c1dbe353ef23d5d5c12987c6df49b1855b67e2a964da74daa2755ee571da96"} Jul 06 14:21:42.920946 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:42.920915 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:42.943018 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:42.942973 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c8dd4dc49-24mk7" podStartSLOduration=1.535142496 podStartE2EDuration="4.942957608s" totalImagesPullingTime="3.407815112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:42.94213402 +0000 UTC m=+123.025427293" watchObservedRunningTime="2026-07-06 14:21:42.942957608 +0000 UTC m=+123.026250881" Jul 06 14:21:43.009905 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:43.009867 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:43.240953 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:43.240864 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:43.340342 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:43.340307 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:43.439875 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:43.439805 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:43.503285 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:43.503199 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:45.739732 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:45.739704 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:21:47.876153 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:47.876117 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:48.183283 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:48.183203 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:48.358686 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:48.358649 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:48.358875 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:48.358734 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:48.363400 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:48.363377 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:48.491118 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:48.491037 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:48.683674 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:48.683644 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:48.947058 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:48.947031 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:21:49.297191 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:49.297156 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:49.429411 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:49.429381 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:50.293989 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:50.293952 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs\") pod \"network-metrics-daemon-bsgjj\" (UID: \"a5c657bf-dc1b-41f9-b16d-7d4336abdd69\") " pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:21:50.296584 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:50.296542 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5c657bf-dc1b-41f9-b16d-7d4336abdd69-metrics-certs\") pod \"network-metrics-daemon-bsgjj\" (UID: \"a5c657bf-dc1b-41f9-b16d-7d4336abdd69\") " pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:21:50.549500 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:50.549422 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nfstm\"" Jul 06 14:21:50.557372 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:50.557351 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsgjj" Jul 06 14:21:50.814749 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:50.814674 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bsgjj"] Jul 06 14:21:50.818224 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:21:50.818194 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c657bf_dc1b_41f9_b16d_7d4336abdd69.slice/crio-7580e5144139b56f07bd99db41c46f1f778ba9773db6d960ee90014dc92b27c0 WatchSource:0}: Error finding container 7580e5144139b56f07bd99db41c46f1f778ba9773db6d960ee90014dc92b27c0: Status 404 returned error can't find the container with id 7580e5144139b56f07bd99db41c46f1f778ba9773db6d960ee90014dc92b27c0 Jul 06 14:21:50.949843 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:50.949807 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bsgjj" event={"ID":"a5c657bf-dc1b-41f9-b16d-7d4336abdd69","Type":"ContainerStarted","Data":"7580e5144139b56f07bd99db41c46f1f778ba9773db6d960ee90014dc92b27c0"} Jul 06 14:21:50.999707 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:50.999677 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:51.114283 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:51.114195 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:52.959252 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:52.959216 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bsgjj" event={"ID":"a5c657bf-dc1b-41f9-b16d-7d4336abdd69","Type":"ContainerStarted","Data":"18300d14c8d4d5c0217b9ea306c23edc51d0e8d6abb5e4b25c556258abe8e780"} Jul 06 14:21:52.959654 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:52.959266 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bsgjj" event={"ID":"a5c657bf-dc1b-41f9-b16d-7d4336abdd69","Type":"ContainerStarted","Data":"2c55b7831d181fb027800c9ef1eb8dc1684c4f9b002af6e4ad83a016ebe90d86"} Jul 06 14:21:52.981301 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:52.981252 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bsgjj" podStartSLOduration=131.611379299 podStartE2EDuration="2m12.981235848s" totalImagesPullingTime="1.369856549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:52.980209336 +0000 UTC m=+133.063502600" watchObservedRunningTime="2026-07-06 14:21:52.981235848 +0000 UTC m=+133.064529103" Jul 06 14:21:53.119049 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:53.119008 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:53.194798 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:53.194762 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:58.164690 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:58.164656 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:21:58.238339 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:21:58.238297 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:00.755270 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:00.755207 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" podUID="38aa2d4f-ea9a-487a-9f1e-b322547d81d3" containerName="registry" containerID="cri-o://923391f9be08b5cc7ce41de5abd3e990968aef05488bcfffd000f5ddc4f6dd0c" gracePeriod=30 Jul 06 14:22:00.990850 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:00.990809 2582 generic.go:356] "Generic (PLEG): container finished" podID="38aa2d4f-ea9a-487a-9f1e-b322547d81d3" containerID="923391f9be08b5cc7ce41de5abd3e990968aef05488bcfffd000f5ddc4f6dd0c" exitCode=0 Jul 06 14:22:00.991007 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:00.990889 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" event={"ID":"38aa2d4f-ea9a-487a-9f1e-b322547d81d3","Type":"ContainerDied","Data":"923391f9be08b5cc7ce41de5abd3e990968aef05488bcfffd000f5ddc4f6dd0c"} Jul 06 14:22:01.021865 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.021844 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:22:01.084955 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.084919 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-certificates\") pod \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " Jul 06 14:22:01.084955 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.084956 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-installation-pull-secrets\") pod \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " Jul 06 14:22:01.085176 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.084985 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-image-registry-private-configuration\") pod \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " Jul 06 14:22:01.085176 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.085020 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-ca-trust-extracted\") pod \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " Jul 06 14:22:01.085176 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.085046 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckvwt\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-kube-api-access-ckvwt\") pod \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " Jul 06 14:22:01.085176 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.085074 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-bound-sa-token\") pod \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " Jul 06 14:22:01.085176 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.085090 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-trusted-ca\") pod \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " Jul 06 14:22:01.085176 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.085105 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls\") pod \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\" (UID: \"38aa2d4f-ea9a-487a-9f1e-b322547d81d3\") " Jul 06 14:22:01.085447 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.085391 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "38aa2d4f-ea9a-487a-9f1e-b322547d81d3" (UID: "38aa2d4f-ea9a-487a-9f1e-b322547d81d3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:22:01.085854 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.085776 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "38aa2d4f-ea9a-487a-9f1e-b322547d81d3" (UID: "38aa2d4f-ea9a-487a-9f1e-b322547d81d3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:22:01.087834 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.087787 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "38aa2d4f-ea9a-487a-9f1e-b322547d81d3" (UID: "38aa2d4f-ea9a-487a-9f1e-b322547d81d3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:22:01.087834 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.087788 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-kube-api-access-ckvwt" (OuterVolumeSpecName: "kube-api-access-ckvwt") pod "38aa2d4f-ea9a-487a-9f1e-b322547d81d3" (UID: "38aa2d4f-ea9a-487a-9f1e-b322547d81d3"). InnerVolumeSpecName "kube-api-access-ckvwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:22:01.088019 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.087916 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "38aa2d4f-ea9a-487a-9f1e-b322547d81d3" (UID: "38aa2d4f-ea9a-487a-9f1e-b322547d81d3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:22:01.088109 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.088087 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "38aa2d4f-ea9a-487a-9f1e-b322547d81d3" (UID: "38aa2d4f-ea9a-487a-9f1e-b322547d81d3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:22:01.088145 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.088092 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "38aa2d4f-ea9a-487a-9f1e-b322547d81d3" (UID: "38aa2d4f-ea9a-487a-9f1e-b322547d81d3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:22:01.096296 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.096267 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "38aa2d4f-ea9a-487a-9f1e-b322547d81d3" (UID: "38aa2d4f-ea9a-487a-9f1e-b322547d81d3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:22:01.186385 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.186341 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-certificates\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:22:01.186385 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.186376 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-installation-pull-secrets\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:22:01.186385 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.186392 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-image-registry-private-configuration\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:22:01.186666 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.186408 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-ca-trust-extracted\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:22:01.186666 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.186419 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckvwt\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-kube-api-access-ckvwt\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:22:01.186666 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.186432 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-bound-sa-token\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:22:01.186666 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.186443 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-trusted-ca\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:22:01.186666 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.186453 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38aa2d4f-ea9a-487a-9f1e-b322547d81d3-registry-tls\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:22:01.995785 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.995757 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" Jul 06 14:22:01.995785 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.995763 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d8849664b-8l2fw" event={"ID":"38aa2d4f-ea9a-487a-9f1e-b322547d81d3","Type":"ContainerDied","Data":"e7def2fab4519f36665244eb9dc597fc2d247156bffe12d6cc85c0ab8dd7b7e7"} Jul 06 14:22:01.996240 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:01.995817 2582 scope.go:117] "RemoveContainer" containerID="923391f9be08b5cc7ce41de5abd3e990968aef05488bcfffd000f5ddc4f6dd0c" Jul 06 14:22:02.022395 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:02.022368 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d8849664b-8l2fw"] Jul 06 14:22:02.032432 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:02.032406 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7d8849664b-8l2fw"] Jul 06 14:22:02.411173 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:02.411141 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38aa2d4f-ea9a-487a-9f1e-b322547d81d3" path="/var/lib/kubelet/pods/38aa2d4f-ea9a-487a-9f1e-b322547d81d3/volumes" Jul 06 14:22:02.742814 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:02.742741 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:02.845668 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:02.845635 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:02.948707 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:02.948677 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:04.826095 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:04.826056 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:10.535751 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:10.535716 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:10.625786 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:10.625738 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:11.029849 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:11.029768 2582 generic.go:356] "Generic (PLEG): container finished" podID="b10bd373-75a4-47dc-9848-85868203da06" containerID="5bc909aa0e42ad7eb7bc8132d1024a872b65d8623dfabff525e48bb19fa7c41d" exitCode=0 Jul 06 14:22:11.029849 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:11.029838 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc" event={"ID":"b10bd373-75a4-47dc-9848-85868203da06","Type":"ContainerDied","Data":"5bc909aa0e42ad7eb7bc8132d1024a872b65d8623dfabff525e48bb19fa7c41d"} Jul 06 14:22:11.030163 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:11.030150 2582 scope.go:117] "RemoveContainer" containerID="5bc909aa0e42ad7eb7bc8132d1024a872b65d8623dfabff525e48bb19fa7c41d" Jul 06 14:22:12.037154 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:12.037124 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-x2tgc" event={"ID":"b10bd373-75a4-47dc-9848-85868203da06","Type":"ContainerStarted","Data":"a92ec8d18ee90e0aba60c222d86b8eb53de8cd20e84b8f930f649e8c36e92a1f"} Jul 06 14:22:16.591916 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:16.591872 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:16.662286 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:16.662245 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:23.881046 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:23.881003 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:43.090629 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:43.090593 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:43.191973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:43.191937 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:52.505710 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.505674 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8b65f45b5-xqbbs"] Jul 06 14:22:52.506184 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.505919 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38aa2d4f-ea9a-487a-9f1e-b322547d81d3" containerName="registry" Jul 06 14:22:52.506184 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.505930 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="38aa2d4f-ea9a-487a-9f1e-b322547d81d3" containerName="registry" Jul 06 14:22:52.506184 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.505978 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="38aa2d4f-ea9a-487a-9f1e-b322547d81d3" containerName="registry" Jul 06 14:22:52.510187 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.510167 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.523318 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.523294 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b65f45b5-xqbbs"] Jul 06 14:22:52.567099 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.567067 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/426d6a77-19e0-4503-8194-1d64dd724351-console-serving-cert\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.567249 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.567105 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-console-config\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.567249 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.567139 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-service-ca\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.567249 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.567161 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-oauth-serving-cert\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.567249 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.567190 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/426d6a77-19e0-4503-8194-1d64dd724351-console-oauth-config\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.567249 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.567212 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-trusted-ca-bundle\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.567419 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.567255 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8xdg\" (UniqueName: \"kubernetes.io/projected/426d6a77-19e0-4503-8194-1d64dd724351-kube-api-access-m8xdg\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.575159 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.575129 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:52.642043 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.642010 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:52.668073 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.668035 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-trusted-ca-bundle\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.668073 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.668076 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8xdg\" (UniqueName: \"kubernetes.io/projected/426d6a77-19e0-4503-8194-1d64dd724351-kube-api-access-m8xdg\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.668281 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.668106 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/426d6a77-19e0-4503-8194-1d64dd724351-console-serving-cert\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.668281 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.668139 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-console-config\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.668281 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.668173 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-service-ca\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.668281 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.668197 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-oauth-serving-cert\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.668469 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.668322 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/426d6a77-19e0-4503-8194-1d64dd724351-console-oauth-config\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.668937 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.668914 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-console-config\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.669103 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.669079 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-trusted-ca-bundle\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.669214 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.669147 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-service-ca\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.669256 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.669199 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-oauth-serving-cert\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.670754 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.670735 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/426d6a77-19e0-4503-8194-1d64dd724351-console-serving-cert\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.670850 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.670778 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/426d6a77-19e0-4503-8194-1d64dd724351-console-oauth-config\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.677151 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.677131 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8xdg\" (UniqueName: \"kubernetes.io/projected/426d6a77-19e0-4503-8194-1d64dd724351-kube-api-access-m8xdg\") pod \"console-8b65f45b5-xqbbs\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.820288 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.820255 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:22:52.952585 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:52.952536 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b65f45b5-xqbbs"] Jul 06 14:22:52.955484 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:22:52.955455 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod426d6a77_19e0_4503_8194_1d64dd724351.slice/crio-53503b66788a41be0ce99ff8043710f2d674329809bff154071ba5da30507d1b WatchSource:0}: Error finding container 53503b66788a41be0ce99ff8043710f2d674329809bff154071ba5da30507d1b: Status 404 returned error can't find the container with id 53503b66788a41be0ce99ff8043710f2d674329809bff154071ba5da30507d1b Jul 06 14:22:53.181483 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:53.181385 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b65f45b5-xqbbs" event={"ID":"426d6a77-19e0-4503-8194-1d64dd724351","Type":"ContainerStarted","Data":"6332511ebfb322b4563ca81a8f267222fe53f94f2ce49c5a26a0b0e867de4a2d"} Jul 06 14:22:53.181483 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:53.181436 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b65f45b5-xqbbs" event={"ID":"426d6a77-19e0-4503-8194-1d64dd724351","Type":"ContainerStarted","Data":"53503b66788a41be0ce99ff8043710f2d674329809bff154071ba5da30507d1b"} Jul 06 14:22:53.206365 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:53.206316 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8b65f45b5-xqbbs" podStartSLOduration=1.206299746 podStartE2EDuration="1.206299746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:22:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:22:53.205538109 +0000 UTC m=+193.288831382" watchObservedRunningTime="2026-07-06 14:22:53.206299746 +0000 UTC m=+193.289593019" Jul 06 14:22:54.968906 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:54.968869 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:22:55.081642 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:22:55.081606 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:02.786253 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:02.782586 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:02.821186 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:02.821151 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:23:02.821337 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:02.821228 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:23:02.825937 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:02.825915 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:23:02.853286 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:02.853255 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:03.219919 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:03.219838 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:23:03.275881 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:03.275849 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c8dd4dc49-24mk7"] Jul 06 14:23:03.402602 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:03.402566 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:03.506410 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:03.506315 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:03.603171 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:03.603133 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:15.402189 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:15.402153 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:28.297368 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.297319 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7c8dd4dc49-24mk7" podUID="015d7cb1-4e59-4e4e-b881-57a49dc26971" containerName="console" containerID="cri-o://15c1dbe353ef23d5d5c12987c6df49b1855b67e2a964da74daa2755ee571da96" gracePeriod=15 Jul 06 14:23:28.549748 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.549691 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:23:28.647352 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.647320 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-console-config\") pod \"015d7cb1-4e59-4e4e-b881-57a49dc26971\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " Jul 06 14:23:28.647352 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.647360 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-oauth-serving-cert\") pod \"015d7cb1-4e59-4e4e-b881-57a49dc26971\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " Jul 06 14:23:28.647623 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.647389 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cd9gx\" (UniqueName: \"kubernetes.io/projected/015d7cb1-4e59-4e4e-b881-57a49dc26971-kube-api-access-cd9gx\") pod \"015d7cb1-4e59-4e4e-b881-57a49dc26971\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " Jul 06 14:23:28.647623 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.647418 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/015d7cb1-4e59-4e4e-b881-57a49dc26971-console-oauth-config\") pod \"015d7cb1-4e59-4e4e-b881-57a49dc26971\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " Jul 06 14:23:28.647623 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.647441 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-trusted-ca-bundle\") pod \"015d7cb1-4e59-4e4e-b881-57a49dc26971\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " Jul 06 14:23:28.647623 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.647469 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-service-ca\") pod \"015d7cb1-4e59-4e4e-b881-57a49dc26971\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " Jul 06 14:23:28.647623 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.647510 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/015d7cb1-4e59-4e4e-b881-57a49dc26971-console-serving-cert\") pod \"015d7cb1-4e59-4e4e-b881-57a49dc26971\" (UID: \"015d7cb1-4e59-4e4e-b881-57a49dc26971\") " Jul 06 14:23:28.647855 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.647798 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "015d7cb1-4e59-4e4e-b881-57a49dc26971" (UID: "015d7cb1-4e59-4e4e-b881-57a49dc26971"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:23:28.647910 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.647892 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-console-config" (OuterVolumeSpecName: "console-config") pod "015d7cb1-4e59-4e4e-b881-57a49dc26971" (UID: "015d7cb1-4e59-4e4e-b881-57a49dc26971"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:23:28.648032 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.648007 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-service-ca" (OuterVolumeSpecName: "service-ca") pod "015d7cb1-4e59-4e4e-b881-57a49dc26971" (UID: "015d7cb1-4e59-4e4e-b881-57a49dc26971"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:23:28.648106 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.648020 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "015d7cb1-4e59-4e4e-b881-57a49dc26971" (UID: "015d7cb1-4e59-4e4e-b881-57a49dc26971"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:23:28.648179 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.648160 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-console-config\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:23:28.648220 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.648188 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-oauth-serving-cert\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:23:28.648220 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.648201 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-trusted-ca-bundle\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:23:28.648220 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.648215 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/015d7cb1-4e59-4e4e-b881-57a49dc26971-service-ca\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:23:28.649981 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.649957 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/015d7cb1-4e59-4e4e-b881-57a49dc26971-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "015d7cb1-4e59-4e4e-b881-57a49dc26971" (UID: "015d7cb1-4e59-4e4e-b881-57a49dc26971"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:23:28.650132 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.650110 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/015d7cb1-4e59-4e4e-b881-57a49dc26971-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "015d7cb1-4e59-4e4e-b881-57a49dc26971" (UID: "015d7cb1-4e59-4e4e-b881-57a49dc26971"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:23:28.650185 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.650126 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/015d7cb1-4e59-4e4e-b881-57a49dc26971-kube-api-access-cd9gx" (OuterVolumeSpecName: "kube-api-access-cd9gx") pod "015d7cb1-4e59-4e4e-b881-57a49dc26971" (UID: "015d7cb1-4e59-4e4e-b881-57a49dc26971"). InnerVolumeSpecName "kube-api-access-cd9gx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:23:28.749336 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.749302 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cd9gx\" (UniqueName: \"kubernetes.io/projected/015d7cb1-4e59-4e4e-b881-57a49dc26971-kube-api-access-cd9gx\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:23:28.749336 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.749330 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/015d7cb1-4e59-4e4e-b881-57a49dc26971-console-oauth-config\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:23:28.749336 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:28.749341 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/015d7cb1-4e59-4e4e-b881-57a49dc26971-console-serving-cert\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:23:29.307326 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:29.307292 2582 generic.go:356] "Generic (PLEG): container finished" podID="015d7cb1-4e59-4e4e-b881-57a49dc26971" containerID="15c1dbe353ef23d5d5c12987c6df49b1855b67e2a964da74daa2755ee571da96" exitCode=0 Jul 06 14:23:29.307819 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:29.307339 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8dd4dc49-24mk7" Jul 06 14:23:29.307819 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:29.307376 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8dd4dc49-24mk7" event={"ID":"015d7cb1-4e59-4e4e-b881-57a49dc26971","Type":"ContainerDied","Data":"15c1dbe353ef23d5d5c12987c6df49b1855b67e2a964da74daa2755ee571da96"} Jul 06 14:23:29.307819 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:29.307429 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8dd4dc49-24mk7" event={"ID":"015d7cb1-4e59-4e4e-b881-57a49dc26971","Type":"ContainerDied","Data":"2adfa0574e45b3fd32694854fcd6cde4398a1d9228d74841bc477ae88d2d9f48"} Jul 06 14:23:29.307819 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:29.307451 2582 scope.go:117] "RemoveContainer" containerID="15c1dbe353ef23d5d5c12987c6df49b1855b67e2a964da74daa2755ee571da96" Jul 06 14:23:29.316196 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:29.316182 2582 scope.go:117] "RemoveContainer" containerID="15c1dbe353ef23d5d5c12987c6df49b1855b67e2a964da74daa2755ee571da96" Jul 06 14:23:29.316486 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:23:29.316466 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15c1dbe353ef23d5d5c12987c6df49b1855b67e2a964da74daa2755ee571da96\": container with ID starting with 15c1dbe353ef23d5d5c12987c6df49b1855b67e2a964da74daa2755ee571da96 not found: ID does not exist" containerID="15c1dbe353ef23d5d5c12987c6df49b1855b67e2a964da74daa2755ee571da96" Jul 06 14:23:29.316559 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:29.316495 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15c1dbe353ef23d5d5c12987c6df49b1855b67e2a964da74daa2755ee571da96"} err="failed to get container status \"15c1dbe353ef23d5d5c12987c6df49b1855b67e2a964da74daa2755ee571da96\": rpc error: code = NotFound desc = could not find container \"15c1dbe353ef23d5d5c12987c6df49b1855b67e2a964da74daa2755ee571da96\": container with ID starting with 15c1dbe353ef23d5d5c12987c6df49b1855b67e2a964da74daa2755ee571da96 not found: ID does not exist" Jul 06 14:23:29.332416 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:29.332392 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c8dd4dc49-24mk7"] Jul 06 14:23:29.337332 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:29.337311 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c8dd4dc49-24mk7"] Jul 06 14:23:30.411288 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:30.411256 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="015d7cb1-4e59-4e4e-b881-57a49dc26971" path="/var/lib/kubelet/pods/015d7cb1-4e59-4e4e-b881-57a49dc26971/volumes" Jul 06 14:23:33.068683 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:33.068643 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:33.166877 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:33.166840 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:33.931388 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:33.931353 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c"] Jul 06 14:23:33.931638 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:33.931624 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="015d7cb1-4e59-4e4e-b881-57a49dc26971" containerName="console" Jul 06 14:23:33.931682 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:33.931641 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="015d7cb1-4e59-4e4e-b881-57a49dc26971" containerName="console" Jul 06 14:23:33.931719 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:33.931684 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="015d7cb1-4e59-4e4e-b881-57a49dc26971" containerName="console" Jul 06 14:23:33.934330 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:33.934315 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c" Jul 06 14:23:33.937690 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:33.937669 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gk2x9\"" Jul 06 14:23:33.938848 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:33.938832 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 14:23:33.938957 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:33.938870 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 14:23:33.948562 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:33.948525 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c"] Jul 06 14:23:34.088936 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:34.088902 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b996444-a0aa-4d58-9485-b27a9385e0cd-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c\" (UID: \"5b996444-a0aa-4d58-9485-b27a9385e0cd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c" Jul 06 14:23:34.089303 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:34.088959 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b996444-a0aa-4d58-9485-b27a9385e0cd-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c\" (UID: \"5b996444-a0aa-4d58-9485-b27a9385e0cd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c" Jul 06 14:23:34.089303 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:34.089005 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55nzs\" (UniqueName: \"kubernetes.io/projected/5b996444-a0aa-4d58-9485-b27a9385e0cd-kube-api-access-55nzs\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c\" (UID: \"5b996444-a0aa-4d58-9485-b27a9385e0cd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c" Jul 06 14:23:34.190143 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:34.190064 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b996444-a0aa-4d58-9485-b27a9385e0cd-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c\" (UID: \"5b996444-a0aa-4d58-9485-b27a9385e0cd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c" Jul 06 14:23:34.190143 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:34.190124 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b996444-a0aa-4d58-9485-b27a9385e0cd-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c\" (UID: \"5b996444-a0aa-4d58-9485-b27a9385e0cd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c" Jul 06 14:23:34.190143 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:34.190142 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55nzs\" (UniqueName: \"kubernetes.io/projected/5b996444-a0aa-4d58-9485-b27a9385e0cd-kube-api-access-55nzs\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c\" (UID: \"5b996444-a0aa-4d58-9485-b27a9385e0cd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c" Jul 06 14:23:34.190467 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:34.190449 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b996444-a0aa-4d58-9485-b27a9385e0cd-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c\" (UID: \"5b996444-a0aa-4d58-9485-b27a9385e0cd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c" Jul 06 14:23:34.190511 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:34.190461 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b996444-a0aa-4d58-9485-b27a9385e0cd-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c\" (UID: \"5b996444-a0aa-4d58-9485-b27a9385e0cd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c" Jul 06 14:23:34.201836 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:34.201807 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55nzs\" (UniqueName: \"kubernetes.io/projected/5b996444-a0aa-4d58-9485-b27a9385e0cd-kube-api-access-55nzs\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c\" (UID: \"5b996444-a0aa-4d58-9485-b27a9385e0cd\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c" Jul 06 14:23:34.243713 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:34.243674 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c" Jul 06 14:23:34.373870 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:34.373729 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c"] Jul 06 14:23:34.376525 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:23:34.376499 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b996444_a0aa_4d58_9485_b27a9385e0cd.slice/crio-23e91bd1e41b67b24e06a1fe65f842ffd113fa0925a1ff7643d8f0faf68b8dcf WatchSource:0}: Error finding container 23e91bd1e41b67b24e06a1fe65f842ffd113fa0925a1ff7643d8f0faf68b8dcf: Status 404 returned error can't find the container with id 23e91bd1e41b67b24e06a1fe65f842ffd113fa0925a1ff7643d8f0faf68b8dcf Jul 06 14:23:35.330406 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:35.330370 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c" event={"ID":"5b996444-a0aa-4d58-9485-b27a9385e0cd","Type":"ContainerStarted","Data":"23e91bd1e41b67b24e06a1fe65f842ffd113fa0925a1ff7643d8f0faf68b8dcf"} Jul 06 14:23:42.363492 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:42.363456 2582 generic.go:356] "Generic (PLEG): container finished" podID="5b996444-a0aa-4d58-9485-b27a9385e0cd" containerID="2eda0b2b4b866c7f3595cd87728156f649aa592aaca82c1aae22d655863ed6f5" exitCode=0 Jul 06 14:23:42.363873 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:42.363538 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c" event={"ID":"5b996444-a0aa-4d58-9485-b27a9385e0cd","Type":"ContainerDied","Data":"2eda0b2b4b866c7f3595cd87728156f649aa592aaca82c1aae22d655863ed6f5"} Jul 06 14:23:44.637712 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:44.637677 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:45.376835 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:45.376805 2582 generic.go:356] "Generic (PLEG): container finished" podID="5b996444-a0aa-4d58-9485-b27a9385e0cd" containerID="cb3f7a1848a5fec5ff291bb39574d12df40546b819a7e7b3d1bf4287d2c88431" exitCode=0 Jul 06 14:23:45.377009 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:45.376878 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c" event={"ID":"5b996444-a0aa-4d58-9485-b27a9385e0cd","Type":"ContainerDied","Data":"cb3f7a1848a5fec5ff291bb39574d12df40546b819a7e7b3d1bf4287d2c88431"} Jul 06 14:23:48.939982 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:48.939951 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:23:55.415626 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:55.415589 2582 generic.go:356] "Generic (PLEG): container finished" podID="5b996444-a0aa-4d58-9485-b27a9385e0cd" containerID="7accaf7c92dff04ca729fe8f2430d0db35dec77d1281e178b4a7e4c7d49c6899" exitCode=0 Jul 06 14:23:55.416034 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:55.415670 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c" event={"ID":"5b996444-a0aa-4d58-9485-b27a9385e0cd","Type":"ContainerDied","Data":"7accaf7c92dff04ca729fe8f2430d0db35dec77d1281e178b4a7e4c7d49c6899"} Jul 06 14:23:56.579426 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:56.579394 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c" Jul 06 14:23:56.667649 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:56.667615 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b996444-a0aa-4d58-9485-b27a9385e0cd-util\") pod \"5b996444-a0aa-4d58-9485-b27a9385e0cd\" (UID: \"5b996444-a0aa-4d58-9485-b27a9385e0cd\") " Jul 06 14:23:56.667795 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:56.667659 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55nzs\" (UniqueName: \"kubernetes.io/projected/5b996444-a0aa-4d58-9485-b27a9385e0cd-kube-api-access-55nzs\") pod \"5b996444-a0aa-4d58-9485-b27a9385e0cd\" (UID: \"5b996444-a0aa-4d58-9485-b27a9385e0cd\") " Jul 06 14:23:56.667795 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:56.667685 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b996444-a0aa-4d58-9485-b27a9385e0cd-bundle\") pod \"5b996444-a0aa-4d58-9485-b27a9385e0cd\" (UID: \"5b996444-a0aa-4d58-9485-b27a9385e0cd\") " Jul 06 14:23:56.668498 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:56.668461 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b996444-a0aa-4d58-9485-b27a9385e0cd-bundle" (OuterVolumeSpecName: "bundle") pod "5b996444-a0aa-4d58-9485-b27a9385e0cd" (UID: "5b996444-a0aa-4d58-9485-b27a9385e0cd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:23:56.670109 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:56.670063 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b996444-a0aa-4d58-9485-b27a9385e0cd-kube-api-access-55nzs" (OuterVolumeSpecName: "kube-api-access-55nzs") pod "5b996444-a0aa-4d58-9485-b27a9385e0cd" (UID: "5b996444-a0aa-4d58-9485-b27a9385e0cd"). InnerVolumeSpecName "kube-api-access-55nzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:23:56.672957 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:56.672938 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b996444-a0aa-4d58-9485-b27a9385e0cd-util" (OuterVolumeSpecName: "util") pod "5b996444-a0aa-4d58-9485-b27a9385e0cd" (UID: "5b996444-a0aa-4d58-9485-b27a9385e0cd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:23:56.768469 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:56.768429 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b996444-a0aa-4d58-9485-b27a9385e0cd-util\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:23:56.768469 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:56.768461 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55nzs\" (UniqueName: \"kubernetes.io/projected/5b996444-a0aa-4d58-9485-b27a9385e0cd-kube-api-access-55nzs\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:23:56.768469 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:56.768473 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b996444-a0aa-4d58-9485-b27a9385e0cd-bundle\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:23:57.424453 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:57.424425 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c" Jul 06 14:23:57.424637 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:57.424425 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ng55c" event={"ID":"5b996444-a0aa-4d58-9485-b27a9385e0cd","Type":"ContainerDied","Data":"23e91bd1e41b67b24e06a1fe65f842ffd113fa0925a1ff7643d8f0faf68b8dcf"} Jul 06 14:23:57.424637 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:23:57.424540 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23e91bd1e41b67b24e06a1fe65f842ffd113fa0925a1ff7643d8f0faf68b8dcf" Jul 06 14:24:00.063212 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:00.063184 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:00.927024 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:00.926988 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:02.260845 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.260763 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xng86"] Jul 06 14:24:02.261193 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.261073 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b996444-a0aa-4d58-9485-b27a9385e0cd" containerName="extract" Jul 06 14:24:02.261193 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.261086 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b996444-a0aa-4d58-9485-b27a9385e0cd" containerName="extract" Jul 06 14:24:02.261193 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.261098 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b996444-a0aa-4d58-9485-b27a9385e0cd" containerName="util" Jul 06 14:24:02.261193 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.261103 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b996444-a0aa-4d58-9485-b27a9385e0cd" containerName="util" Jul 06 14:24:02.261193 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.261115 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b996444-a0aa-4d58-9485-b27a9385e0cd" containerName="pull" Jul 06 14:24:02.261193 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.261120 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b996444-a0aa-4d58-9485-b27a9385e0cd" containerName="pull" Jul 06 14:24:02.261193 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.261161 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b996444-a0aa-4d58-9485-b27a9385e0cd" containerName="extract" Jul 06 14:24:02.263882 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.263867 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xng86" Jul 06 14:24:02.266770 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.266749 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 14:24:02.266922 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.266791 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 14:24:02.266922 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.266856 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bfjzn\"" Jul 06 14:24:02.275975 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.275952 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xng86"] Jul 06 14:24:02.303578 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.303534 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4d6604e-9ada-4d9a-9ac1-669d604d394a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xng86\" (UID: \"e4d6604e-9ada-4d9a-9ac1-669d604d394a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xng86" Jul 06 14:24:02.303714 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.303602 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgfh8\" (UniqueName: \"kubernetes.io/projected/e4d6604e-9ada-4d9a-9ac1-669d604d394a-kube-api-access-bgfh8\") pod \"cert-manager-operator-controller-manager-55c444bf86-xng86\" (UID: \"e4d6604e-9ada-4d9a-9ac1-669d604d394a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xng86" Jul 06 14:24:02.403979 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.403947 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgfh8\" (UniqueName: \"kubernetes.io/projected/e4d6604e-9ada-4d9a-9ac1-669d604d394a-kube-api-access-bgfh8\") pod \"cert-manager-operator-controller-manager-55c444bf86-xng86\" (UID: \"e4d6604e-9ada-4d9a-9ac1-669d604d394a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xng86" Jul 06 14:24:02.404144 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.404005 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4d6604e-9ada-4d9a-9ac1-669d604d394a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xng86\" (UID: \"e4d6604e-9ada-4d9a-9ac1-669d604d394a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xng86" Jul 06 14:24:02.404301 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.404286 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4d6604e-9ada-4d9a-9ac1-669d604d394a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xng86\" (UID: \"e4d6604e-9ada-4d9a-9ac1-669d604d394a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xng86" Jul 06 14:24:02.414280 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.414255 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgfh8\" (UniqueName: \"kubernetes.io/projected/e4d6604e-9ada-4d9a-9ac1-669d604d394a-kube-api-access-bgfh8\") pod \"cert-manager-operator-controller-manager-55c444bf86-xng86\" (UID: \"e4d6604e-9ada-4d9a-9ac1-669d604d394a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xng86" Jul 06 14:24:02.572200 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.572169 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xng86" Jul 06 14:24:02.707333 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:02.707300 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xng86"] Jul 06 14:24:02.711181 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:24:02.711151 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d6604e_9ada_4d9a_9ac1_669d604d394a.slice/crio-561e20496a8ff6f5bf2b75d4c72575e4e29b52fb3c930e9f5b11e9bef6745821 WatchSource:0}: Error finding container 561e20496a8ff6f5bf2b75d4c72575e4e29b52fb3c930e9f5b11e9bef6745821: Status 404 returned error can't find the container with id 561e20496a8ff6f5bf2b75d4c72575e4e29b52fb3c930e9f5b11e9bef6745821 Jul 06 14:24:03.446281 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:03.446244 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xng86" event={"ID":"e4d6604e-9ada-4d9a-9ac1-669d604d394a","Type":"ContainerStarted","Data":"561e20496a8ff6f5bf2b75d4c72575e4e29b52fb3c930e9f5b11e9bef6745821"} Jul 06 14:24:04.089530 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:04.089491 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:04.168045 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:04.167995 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:05.456628 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:05.456587 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xng86" event={"ID":"e4d6604e-9ada-4d9a-9ac1-669d604d394a","Type":"ContainerStarted","Data":"5f062a20748354a1fdf1681e47a4adfa5c4655f6aab01ad8b63d6501ee559bbc"} Jul 06 14:24:05.480195 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:05.480143 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xng86" podStartSLOduration=1.5598456010000001 podStartE2EDuration="3.480129396s" totalImagesPullingTime="1.920283795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:05.477052691 +0000 UTC m=+265.560345977" watchObservedRunningTime="2026-07-06 14:24:05.480129396 +0000 UTC m=+265.563422668" Jul 06 14:24:05.901050 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:05.901014 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:06.127573 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.127521 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:06.205512 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.205432 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz"] Jul 06 14:24:06.208961 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.208945 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz" Jul 06 14:24:06.216878 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.216859 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gk2x9\"" Jul 06 14:24:06.217222 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.217207 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 14:24:06.217953 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.217937 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 14:24:06.223064 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.223044 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz"] Jul 06 14:24:06.235013 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.234987 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbp9b\" (UniqueName: \"kubernetes.io/projected/fadd91e1-2fd3-41b2-bbed-e68e706bd76c-kube-api-access-jbp9b\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz\" (UID: \"fadd91e1-2fd3-41b2-bbed-e68e706bd76c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz" Jul 06 14:24:06.235095 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.235034 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fadd91e1-2fd3-41b2-bbed-e68e706bd76c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz\" (UID: \"fadd91e1-2fd3-41b2-bbed-e68e706bd76c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz" Jul 06 14:24:06.235095 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.235053 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fadd91e1-2fd3-41b2-bbed-e68e706bd76c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz\" (UID: \"fadd91e1-2fd3-41b2-bbed-e68e706bd76c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz" Jul 06 14:24:06.336339 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.336304 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbp9b\" (UniqueName: \"kubernetes.io/projected/fadd91e1-2fd3-41b2-bbed-e68e706bd76c-kube-api-access-jbp9b\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz\" (UID: \"fadd91e1-2fd3-41b2-bbed-e68e706bd76c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz" Jul 06 14:24:06.336526 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.336350 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fadd91e1-2fd3-41b2-bbed-e68e706bd76c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz\" (UID: \"fadd91e1-2fd3-41b2-bbed-e68e706bd76c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz" Jul 06 14:24:06.336526 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.336371 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fadd91e1-2fd3-41b2-bbed-e68e706bd76c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz\" (UID: \"fadd91e1-2fd3-41b2-bbed-e68e706bd76c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz" Jul 06 14:24:06.336798 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.336779 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fadd91e1-2fd3-41b2-bbed-e68e706bd76c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz\" (UID: \"fadd91e1-2fd3-41b2-bbed-e68e706bd76c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz" Jul 06 14:24:06.336798 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.336794 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fadd91e1-2fd3-41b2-bbed-e68e706bd76c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz\" (UID: \"fadd91e1-2fd3-41b2-bbed-e68e706bd76c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz" Jul 06 14:24:06.359418 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.359392 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbp9b\" (UniqueName: \"kubernetes.io/projected/fadd91e1-2fd3-41b2-bbed-e68e706bd76c-kube-api-access-jbp9b\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz\" (UID: \"fadd91e1-2fd3-41b2-bbed-e68e706bd76c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz" Jul 06 14:24:06.451400 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.451357 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:06.517814 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.517740 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz" Jul 06 14:24:06.571743 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.571695 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:06.655747 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:06.655715 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz"] Jul 06 14:24:06.658494 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:24:06.658462 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfadd91e1_2fd3_41b2_bbed_e68e706bd76c.slice/crio-c92abad4245a2712268a980f3c48214de7c7f40ddcb8f18a53f3b248ece6ca92 WatchSource:0}: Error finding container c92abad4245a2712268a980f3c48214de7c7f40ddcb8f18a53f3b248ece6ca92: Status 404 returned error can't find the container with id c92abad4245a2712268a980f3c48214de7c7f40ddcb8f18a53f3b248ece6ca92 Jul 06 14:24:07.464951 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:07.464908 2582 generic.go:356] "Generic (PLEG): container finished" podID="fadd91e1-2fd3-41b2-bbed-e68e706bd76c" containerID="793606ff0e7a6b813d54f6db337f40bd616a3413a673ea60c066758a17fa60c0" exitCode=0 Jul 06 14:24:07.465128 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:07.465005 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz" event={"ID":"fadd91e1-2fd3-41b2-bbed-e68e706bd76c","Type":"ContainerDied","Data":"793606ff0e7a6b813d54f6db337f40bd616a3413a673ea60c066758a17fa60c0"} Jul 06 14:24:07.465128 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:07.465058 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz" event={"ID":"fadd91e1-2fd3-41b2-bbed-e68e706bd76c","Type":"ContainerStarted","Data":"c92abad4245a2712268a980f3c48214de7c7f40ddcb8f18a53f3b248ece6ca92"} Jul 06 14:24:08.791901 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:08.791864 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:08.974615 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:08.974539 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nzcsw"] Jul 06 14:24:08.977838 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:08.977816 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzcsw" Jul 06 14:24:08.980467 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:08.980444 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 14:24:08.980610 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:08.980541 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 14:24:08.988715 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:08.988693 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nzcsw"] Jul 06 14:24:09.055249 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:09.055149 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f10d91d-9ce5-49b1-8d22-5440788ac7cb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nzcsw\" (UID: \"9f10d91d-9ce5-49b1-8d22-5440788ac7cb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzcsw" Jul 06 14:24:09.055422 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:09.055283 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9mcl\" (UniqueName: \"kubernetes.io/projected/9f10d91d-9ce5-49b1-8d22-5440788ac7cb-kube-api-access-p9mcl\") pod \"cert-manager-cainjector-559cdd8c87-nzcsw\" (UID: \"9f10d91d-9ce5-49b1-8d22-5440788ac7cb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzcsw" Jul 06 14:24:09.055422 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:09.055301 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:09.156206 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:09.156169 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9mcl\" (UniqueName: \"kubernetes.io/projected/9f10d91d-9ce5-49b1-8d22-5440788ac7cb-kube-api-access-p9mcl\") pod \"cert-manager-cainjector-559cdd8c87-nzcsw\" (UID: \"9f10d91d-9ce5-49b1-8d22-5440788ac7cb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzcsw" Jul 06 14:24:09.156206 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:09.156211 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f10d91d-9ce5-49b1-8d22-5440788ac7cb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nzcsw\" (UID: \"9f10d91d-9ce5-49b1-8d22-5440788ac7cb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzcsw" Jul 06 14:24:09.169352 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:09.169321 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f10d91d-9ce5-49b1-8d22-5440788ac7cb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nzcsw\" (UID: \"9f10d91d-9ce5-49b1-8d22-5440788ac7cb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzcsw" Jul 06 14:24:09.170141 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:09.170122 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9mcl\" (UniqueName: \"kubernetes.io/projected/9f10d91d-9ce5-49b1-8d22-5440788ac7cb-kube-api-access-p9mcl\") pod \"cert-manager-cainjector-559cdd8c87-nzcsw\" (UID: \"9f10d91d-9ce5-49b1-8d22-5440788ac7cb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzcsw" Jul 06 14:24:09.287038 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:09.287006 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzcsw" Jul 06 14:24:09.416113 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:09.416091 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nzcsw"] Jul 06 14:24:09.418414 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:24:09.418383 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f10d91d_9ce5_49b1_8d22_5440788ac7cb.slice/crio-769d5efc10300bd3b9aa1b5b112dbc8baffab91a6c0dd5c895fef617da6da5fe WatchSource:0}: Error finding container 769d5efc10300bd3b9aa1b5b112dbc8baffab91a6c0dd5c895fef617da6da5fe: Status 404 returned error can't find the container with id 769d5efc10300bd3b9aa1b5b112dbc8baffab91a6c0dd5c895fef617da6da5fe Jul 06 14:24:09.474178 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:09.474143 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzcsw" event={"ID":"9f10d91d-9ce5-49b1-8d22-5440788ac7cb","Type":"ContainerStarted","Data":"769d5efc10300bd3b9aa1b5b112dbc8baffab91a6c0dd5c895fef617da6da5fe"} Jul 06 14:24:10.458029 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:10.457989 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:10.531208 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:10.531165 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:12.487219 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:12.487126 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzcsw" event={"ID":"9f10d91d-9ce5-49b1-8d22-5440788ac7cb","Type":"ContainerStarted","Data":"2ce6168b36331ce25aefbc2b5ad0380e6e3b59833a52751995ed59b0b0ac6257"} Jul 06 14:24:12.515420 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:12.515176 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzcsw" podStartSLOduration=1.715173551 podStartE2EDuration="4.51515562s" totalImagesPullingTime="2.799982069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:12.513909841 +0000 UTC m=+272.597203116" watchObservedRunningTime="2026-07-06 14:24:12.51515562 +0000 UTC m=+272.598448893" Jul 06 14:24:16.403658 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:16.403623 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:22.529116 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:22.529025 2582 generic.go:356] "Generic (PLEG): container finished" podID="fadd91e1-2fd3-41b2-bbed-e68e706bd76c" containerID="0e70ff7ed1f7af3ca1d4a2ae87dacc8ef07376724a277c8dbf71fa8d629099c4" exitCode=0 Jul 06 14:24:22.529116 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:22.529095 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz" event={"ID":"fadd91e1-2fd3-41b2-bbed-e68e706bd76c","Type":"ContainerDied","Data":"0e70ff7ed1f7af3ca1d4a2ae87dacc8ef07376724a277c8dbf71fa8d629099c4"} Jul 06 14:24:23.535399 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:23.535369 2582 generic.go:356] "Generic (PLEG): container finished" podID="fadd91e1-2fd3-41b2-bbed-e68e706bd76c" containerID="7471e34505201963bccaeaeaaa45dfa08af19856e1b704d1afcbfd94cb90e313" exitCode=0 Jul 06 14:24:23.535802 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:23.535431 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz" event={"ID":"fadd91e1-2fd3-41b2-bbed-e68e706bd76c","Type":"ContainerDied","Data":"7471e34505201963bccaeaeaaa45dfa08af19856e1b704d1afcbfd94cb90e313"} Jul 06 14:24:24.684666 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:24.684635 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz" Jul 06 14:24:24.783564 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:24.783523 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fadd91e1-2fd3-41b2-bbed-e68e706bd76c-bundle\") pod \"fadd91e1-2fd3-41b2-bbed-e68e706bd76c\" (UID: \"fadd91e1-2fd3-41b2-bbed-e68e706bd76c\") " Jul 06 14:24:24.783732 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:24.783607 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbp9b\" (UniqueName: \"kubernetes.io/projected/fadd91e1-2fd3-41b2-bbed-e68e706bd76c-kube-api-access-jbp9b\") pod \"fadd91e1-2fd3-41b2-bbed-e68e706bd76c\" (UID: \"fadd91e1-2fd3-41b2-bbed-e68e706bd76c\") " Jul 06 14:24:24.783732 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:24.783629 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fadd91e1-2fd3-41b2-bbed-e68e706bd76c-util\") pod \"fadd91e1-2fd3-41b2-bbed-e68e706bd76c\" (UID: \"fadd91e1-2fd3-41b2-bbed-e68e706bd76c\") " Jul 06 14:24:24.783950 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:24.783920 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fadd91e1-2fd3-41b2-bbed-e68e706bd76c-bundle" (OuterVolumeSpecName: "bundle") pod "fadd91e1-2fd3-41b2-bbed-e68e706bd76c" (UID: "fadd91e1-2fd3-41b2-bbed-e68e706bd76c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:24:24.785880 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:24.785850 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fadd91e1-2fd3-41b2-bbed-e68e706bd76c-kube-api-access-jbp9b" (OuterVolumeSpecName: "kube-api-access-jbp9b") pod "fadd91e1-2fd3-41b2-bbed-e68e706bd76c" (UID: "fadd91e1-2fd3-41b2-bbed-e68e706bd76c"). InnerVolumeSpecName "kube-api-access-jbp9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:24:24.787895 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:24.787875 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fadd91e1-2fd3-41b2-bbed-e68e706bd76c-util" (OuterVolumeSpecName: "util") pod "fadd91e1-2fd3-41b2-bbed-e68e706bd76c" (UID: "fadd91e1-2fd3-41b2-bbed-e68e706bd76c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:24:24.884811 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:24.884725 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbp9b\" (UniqueName: \"kubernetes.io/projected/fadd91e1-2fd3-41b2-bbed-e68e706bd76c-kube-api-access-jbp9b\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:24:24.884811 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:24.884755 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fadd91e1-2fd3-41b2-bbed-e68e706bd76c-util\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:24:24.884811 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:24.884767 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fadd91e1-2fd3-41b2-bbed-e68e706bd76c-bundle\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:24:25.544730 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:25.544694 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz" event={"ID":"fadd91e1-2fd3-41b2-bbed-e68e706bd76c","Type":"ContainerDied","Data":"c92abad4245a2712268a980f3c48214de7c7f40ddcb8f18a53f3b248ece6ca92"} Jul 06 14:24:25.544730 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:25.544716 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvssmz" Jul 06 14:24:25.544943 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:25.544749 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c92abad4245a2712268a980f3c48214de7c7f40ddcb8f18a53f3b248ece6ca92" Jul 06 14:24:30.253192 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:30.253151 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:30.353754 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:30.353717 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:31.989404 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:31.989362 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bvgs7"] Jul 06 14:24:31.989823 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:31.989646 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fadd91e1-2fd3-41b2-bbed-e68e706bd76c" containerName="util" Jul 06 14:24:31.989823 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:31.989659 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fadd91e1-2fd3-41b2-bbed-e68e706bd76c" containerName="util" Jul 06 14:24:31.989823 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:31.989673 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fadd91e1-2fd3-41b2-bbed-e68e706bd76c" containerName="extract" Jul 06 14:24:31.989823 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:31.989678 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fadd91e1-2fd3-41b2-bbed-e68e706bd76c" containerName="extract" Jul 06 14:24:31.989823 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:31.989687 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fadd91e1-2fd3-41b2-bbed-e68e706bd76c" containerName="pull" Jul 06 14:24:31.989823 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:31.989692 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fadd91e1-2fd3-41b2-bbed-e68e706bd76c" containerName="pull" Jul 06 14:24:31.989823 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:31.989736 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fadd91e1-2fd3-41b2-bbed-e68e706bd76c" containerName="extract" Jul 06 14:24:31.992333 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:31.992316 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bvgs7" Jul 06 14:24:31.995100 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:31.995077 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 14:24:31.995482 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:31.995469 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-s94qg\"" Jul 06 14:24:31.996579 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:31.996541 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 14:24:32.003521 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:32.003496 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bvgs7"] Jul 06 14:24:32.145168 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:32.145135 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49fc0416-87a4-4705-b184-09ceb911cfc7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bvgs7\" (UID: \"49fc0416-87a4-4705-b184-09ceb911cfc7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bvgs7" Jul 06 14:24:32.145347 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:32.145188 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvvp4\" (UniqueName: \"kubernetes.io/projected/49fc0416-87a4-4705-b184-09ceb911cfc7-kube-api-access-wvvp4\") pod \"openshift-lws-operator-fd8ccff4c-bvgs7\" (UID: \"49fc0416-87a4-4705-b184-09ceb911cfc7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bvgs7" Jul 06 14:24:32.246100 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:32.246009 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49fc0416-87a4-4705-b184-09ceb911cfc7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bvgs7\" (UID: \"49fc0416-87a4-4705-b184-09ceb911cfc7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bvgs7" Jul 06 14:24:32.246100 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:32.246063 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvvp4\" (UniqueName: \"kubernetes.io/projected/49fc0416-87a4-4705-b184-09ceb911cfc7-kube-api-access-wvvp4\") pod \"openshift-lws-operator-fd8ccff4c-bvgs7\" (UID: \"49fc0416-87a4-4705-b184-09ceb911cfc7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bvgs7" Jul 06 14:24:32.246393 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:32.246373 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49fc0416-87a4-4705-b184-09ceb911cfc7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bvgs7\" (UID: \"49fc0416-87a4-4705-b184-09ceb911cfc7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bvgs7" Jul 06 14:24:32.255789 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:32.255768 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvvp4\" (UniqueName: \"kubernetes.io/projected/49fc0416-87a4-4705-b184-09ceb911cfc7-kube-api-access-wvvp4\") pod \"openshift-lws-operator-fd8ccff4c-bvgs7\" (UID: \"49fc0416-87a4-4705-b184-09ceb911cfc7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bvgs7" Jul 06 14:24:32.301472 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:32.301439 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bvgs7" Jul 06 14:24:32.432469 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:32.432444 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bvgs7"] Jul 06 14:24:32.434810 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:24:32.434780 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49fc0416_87a4_4705_b184_09ceb911cfc7.slice/crio-844622e371a354049cb22d65c487c94335db78743234626a29b27609b0f49c2e WatchSource:0}: Error finding container 844622e371a354049cb22d65c487c94335db78743234626a29b27609b0f49c2e: Status 404 returned error can't find the container with id 844622e371a354049cb22d65c487c94335db78743234626a29b27609b0f49c2e Jul 06 14:24:32.572939 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:32.572899 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bvgs7" event={"ID":"49fc0416-87a4-4705-b184-09ceb911cfc7","Type":"ContainerStarted","Data":"844622e371a354049cb22d65c487c94335db78743234626a29b27609b0f49c2e"} Jul 06 14:24:35.587002 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:35.586963 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bvgs7" event={"ID":"49fc0416-87a4-4705-b184-09ceb911cfc7","Type":"ContainerStarted","Data":"b252160602c5f90c49ffacb4181790341a6abcf66e82242135677fbec24a6bb8"} Jul 06 14:24:35.604523 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:35.604466 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bvgs7" podStartSLOduration=2.431402781 podStartE2EDuration="4.604450968s" totalImagesPullingTime="2.173048187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:35.603825675 +0000 UTC m=+295.687118949" watchObservedRunningTime="2026-07-06 14:24:35.604450968 +0000 UTC m=+295.687744240" Jul 06 14:24:36.345609 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:36.345574 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:36.449472 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:36.449434 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:38.050591 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.050541 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl"] Jul 06 14:24:38.053853 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.053837 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" Jul 06 14:24:38.056241 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.056217 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 14:24:38.056367 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.056218 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 14:24:38.056367 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.056310 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gk2x9\"" Jul 06 14:24:38.064117 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.064098 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl"] Jul 06 14:24:38.191267 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.191233 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25a387eb-6ef7-4401-95b1-0808a1dd146f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl\" (UID: \"25a387eb-6ef7-4401-95b1-0808a1dd146f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" Jul 06 14:24:38.191435 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.191289 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25a387eb-6ef7-4401-95b1-0808a1dd146f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl\" (UID: \"25a387eb-6ef7-4401-95b1-0808a1dd146f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" Jul 06 14:24:38.191435 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.191319 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56q5v\" (UniqueName: \"kubernetes.io/projected/25a387eb-6ef7-4401-95b1-0808a1dd146f-kube-api-access-56q5v\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl\" (UID: \"25a387eb-6ef7-4401-95b1-0808a1dd146f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" Jul 06 14:24:38.292159 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.292121 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25a387eb-6ef7-4401-95b1-0808a1dd146f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl\" (UID: \"25a387eb-6ef7-4401-95b1-0808a1dd146f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" Jul 06 14:24:38.292353 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.292327 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25a387eb-6ef7-4401-95b1-0808a1dd146f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl\" (UID: \"25a387eb-6ef7-4401-95b1-0808a1dd146f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" Jul 06 14:24:38.292432 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.292370 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56q5v\" (UniqueName: \"kubernetes.io/projected/25a387eb-6ef7-4401-95b1-0808a1dd146f-kube-api-access-56q5v\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl\" (UID: \"25a387eb-6ef7-4401-95b1-0808a1dd146f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" Jul 06 14:24:38.292624 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.292605 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25a387eb-6ef7-4401-95b1-0808a1dd146f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl\" (UID: \"25a387eb-6ef7-4401-95b1-0808a1dd146f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" Jul 06 14:24:38.292708 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.292687 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25a387eb-6ef7-4401-95b1-0808a1dd146f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl\" (UID: \"25a387eb-6ef7-4401-95b1-0808a1dd146f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" Jul 06 14:24:38.309764 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.309689 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56q5v\" (UniqueName: \"kubernetes.io/projected/25a387eb-6ef7-4401-95b1-0808a1dd146f-kube-api-access-56q5v\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl\" (UID: \"25a387eb-6ef7-4401-95b1-0808a1dd146f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" Jul 06 14:24:38.336250 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.336220 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:38.363153 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.363116 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" Jul 06 14:24:38.496369 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.496345 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl"] Jul 06 14:24:38.498018 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:24:38.497997 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a387eb_6ef7_4401_95b1_0808a1dd146f.slice/crio-ec5d0e2bf17e7ba95b5d67e58a242f1d48dba42c8e5585e3af82a39a256c1315 WatchSource:0}: Error finding container ec5d0e2bf17e7ba95b5d67e58a242f1d48dba42c8e5585e3af82a39a256c1315: Status 404 returned error can't find the container with id ec5d0e2bf17e7ba95b5d67e58a242f1d48dba42c8e5585e3af82a39a256c1315 Jul 06 14:24:38.599533 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.599507 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" event={"ID":"25a387eb-6ef7-4401-95b1-0808a1dd146f","Type":"ContainerStarted","Data":"a5a52ff4b3d67d4c1533675583f639d0d2f0856702ff21feef9be3f4f2063016"} Jul 06 14:24:38.599667 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:38.599578 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" event={"ID":"25a387eb-6ef7-4401-95b1-0808a1dd146f","Type":"ContainerStarted","Data":"ec5d0e2bf17e7ba95b5d67e58a242f1d48dba42c8e5585e3af82a39a256c1315"} Jul 06 14:24:39.605110 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:39.605075 2582 generic.go:356] "Generic (PLEG): container finished" podID="25a387eb-6ef7-4401-95b1-0808a1dd146f" containerID="a5a52ff4b3d67d4c1533675583f639d0d2f0856702ff21feef9be3f4f2063016" exitCode=0 Jul 06 14:24:39.605110 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:39.605103 2582 generic.go:356] "Generic (PLEG): container finished" podID="25a387eb-6ef7-4401-95b1-0808a1dd146f" containerID="dffe28e1e6c3bccc16c019dfe583f4758fcb4e306f9326fc5511be222f4253c9" exitCode=0 Jul 06 14:24:39.605512 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:39.605133 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" event={"ID":"25a387eb-6ef7-4401-95b1-0808a1dd146f","Type":"ContainerDied","Data":"a5a52ff4b3d67d4c1533675583f639d0d2f0856702ff21feef9be3f4f2063016"} Jul 06 14:24:39.605512 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:39.605168 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" event={"ID":"25a387eb-6ef7-4401-95b1-0808a1dd146f","Type":"ContainerDied","Data":"dffe28e1e6c3bccc16c019dfe583f4758fcb4e306f9326fc5511be222f4253c9"} Jul 06 14:24:40.357419 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:40.357385 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 14:24:40.610815 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:40.610725 2582 generic.go:356] "Generic (PLEG): container finished" podID="25a387eb-6ef7-4401-95b1-0808a1dd146f" containerID="d638aae893bfa7f6cd7923e7c334352984bab4ae567513d646ea4d90e5763acb" exitCode=0 Jul 06 14:24:40.610815 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:40.610780 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" event={"ID":"25a387eb-6ef7-4401-95b1-0808a1dd146f","Type":"ContainerDied","Data":"d638aae893bfa7f6cd7923e7c334352984bab4ae567513d646ea4d90e5763acb"} Jul 06 14:24:41.749443 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:41.749419 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" Jul 06 14:24:41.819884 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:41.819851 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25a387eb-6ef7-4401-95b1-0808a1dd146f-util\") pod \"25a387eb-6ef7-4401-95b1-0808a1dd146f\" (UID: \"25a387eb-6ef7-4401-95b1-0808a1dd146f\") " Jul 06 14:24:41.820077 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:41.819923 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56q5v\" (UniqueName: \"kubernetes.io/projected/25a387eb-6ef7-4401-95b1-0808a1dd146f-kube-api-access-56q5v\") pod \"25a387eb-6ef7-4401-95b1-0808a1dd146f\" (UID: \"25a387eb-6ef7-4401-95b1-0808a1dd146f\") " Jul 06 14:24:41.820077 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:41.819962 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25a387eb-6ef7-4401-95b1-0808a1dd146f-bundle\") pod \"25a387eb-6ef7-4401-95b1-0808a1dd146f\" (UID: \"25a387eb-6ef7-4401-95b1-0808a1dd146f\") " Jul 06 14:24:41.820644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:41.820605 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25a387eb-6ef7-4401-95b1-0808a1dd146f-bundle" (OuterVolumeSpecName: "bundle") pod "25a387eb-6ef7-4401-95b1-0808a1dd146f" (UID: "25a387eb-6ef7-4401-95b1-0808a1dd146f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:24:41.822186 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:41.822156 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25a387eb-6ef7-4401-95b1-0808a1dd146f-kube-api-access-56q5v" (OuterVolumeSpecName: "kube-api-access-56q5v") pod "25a387eb-6ef7-4401-95b1-0808a1dd146f" (UID: "25a387eb-6ef7-4401-95b1-0808a1dd146f"). InnerVolumeSpecName "kube-api-access-56q5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:24:41.825774 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:41.825706 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25a387eb-6ef7-4401-95b1-0808a1dd146f-util" (OuterVolumeSpecName: "util") pod "25a387eb-6ef7-4401-95b1-0808a1dd146f" (UID: "25a387eb-6ef7-4401-95b1-0808a1dd146f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:24:41.921264 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:41.921175 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25a387eb-6ef7-4401-95b1-0808a1dd146f-bundle\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:24:41.921264 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:41.921202 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25a387eb-6ef7-4401-95b1-0808a1dd146f-util\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:24:41.921264 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:41.921214 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56q5v\" (UniqueName: \"kubernetes.io/projected/25a387eb-6ef7-4401-95b1-0808a1dd146f-kube-api-access-56q5v\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:24:42.620896 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:42.620856 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" event={"ID":"25a387eb-6ef7-4401-95b1-0808a1dd146f","Type":"ContainerDied","Data":"ec5d0e2bf17e7ba95b5d67e58a242f1d48dba42c8e5585e3af82a39a256c1315"} Jul 06 14:24:42.621066 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:42.620908 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec5d0e2bf17e7ba95b5d67e58a242f1d48dba42c8e5585e3af82a39a256c1315" Jul 06 14:24:42.621066 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:42.620909 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afggqwl" Jul 06 14:24:44.362516 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:44.362482 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:44.479134 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:44.479090 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:54.020305 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:54.020266 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:54.121438 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:54.121392 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:54.500686 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:54.500649 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:54.611966 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:54.611931 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:54.863030 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:54.862998 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:54.989434 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:54.989400 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs"] Jul 06 14:24:54.989674 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:54.989661 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25a387eb-6ef7-4401-95b1-0808a1dd146f" containerName="util" Jul 06 14:24:54.989674 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:54.989675 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="25a387eb-6ef7-4401-95b1-0808a1dd146f" containerName="util" Jul 06 14:24:54.989765 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:54.989687 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25a387eb-6ef7-4401-95b1-0808a1dd146f" containerName="pull" Jul 06 14:24:54.989765 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:54.989692 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="25a387eb-6ef7-4401-95b1-0808a1dd146f" containerName="pull" Jul 06 14:24:54.989765 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:54.989699 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25a387eb-6ef7-4401-95b1-0808a1dd146f" containerName="extract" Jul 06 14:24:54.989765 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:54.989704 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="25a387eb-6ef7-4401-95b1-0808a1dd146f" containerName="extract" Jul 06 14:24:54.989765 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:54.989763 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="25a387eb-6ef7-4401-95b1-0808a1dd146f" containerName="extract" Jul 06 14:24:54.993800 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:54.993778 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" Jul 06 14:24:54.997504 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:54.997474 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 14:24:54.997666 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:54.997519 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6fhvm\"" Jul 06 14:24:54.997666 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:54.997576 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 14:24:54.997666 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:54.997585 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 14:24:55.010579 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.010534 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs"] Jul 06 14:24:55.014824 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.014793 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:55.122690 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.122595 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:55.127530 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.127506 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8d76683-c9e9-4847-a624-2af67b808c8e-cert\") pod \"lws-controller-manager-7d677d8c9-7z9vs\" (UID: \"c8d76683-c9e9-4847-a624-2af67b808c8e\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" Jul 06 14:24:55.127673 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.127578 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c8d76683-c9e9-4847-a624-2af67b808c8e-manager-config\") pod \"lws-controller-manager-7d677d8c9-7z9vs\" (UID: \"c8d76683-c9e9-4847-a624-2af67b808c8e\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" Jul 06 14:24:55.127673 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.127604 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8d76683-c9e9-4847-a624-2af67b808c8e-metrics-cert\") pod \"lws-controller-manager-7d677d8c9-7z9vs\" (UID: \"c8d76683-c9e9-4847-a624-2af67b808c8e\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" Jul 06 14:24:55.127673 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.127663 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmlsq\" (UniqueName: \"kubernetes.io/projected/c8d76683-c9e9-4847-a624-2af67b808c8e-kube-api-access-zmlsq\") pod \"lws-controller-manager-7d677d8c9-7z9vs\" (UID: \"c8d76683-c9e9-4847-a624-2af67b808c8e\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" Jul 06 14:24:55.228711 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.228679 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8d76683-c9e9-4847-a624-2af67b808c8e-cert\") pod \"lws-controller-manager-7d677d8c9-7z9vs\" (UID: \"c8d76683-c9e9-4847-a624-2af67b808c8e\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" Jul 06 14:24:55.228926 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.228729 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c8d76683-c9e9-4847-a624-2af67b808c8e-manager-config\") pod \"lws-controller-manager-7d677d8c9-7z9vs\" (UID: \"c8d76683-c9e9-4847-a624-2af67b808c8e\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" Jul 06 14:24:55.228926 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.228750 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8d76683-c9e9-4847-a624-2af67b808c8e-metrics-cert\") pod \"lws-controller-manager-7d677d8c9-7z9vs\" (UID: \"c8d76683-c9e9-4847-a624-2af67b808c8e\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" Jul 06 14:24:55.228926 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.228787 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmlsq\" (UniqueName: \"kubernetes.io/projected/c8d76683-c9e9-4847-a624-2af67b808c8e-kube-api-access-zmlsq\") pod \"lws-controller-manager-7d677d8c9-7z9vs\" (UID: \"c8d76683-c9e9-4847-a624-2af67b808c8e\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" Jul 06 14:24:55.229432 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.229409 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c8d76683-c9e9-4847-a624-2af67b808c8e-manager-config\") pod \"lws-controller-manager-7d677d8c9-7z9vs\" (UID: \"c8d76683-c9e9-4847-a624-2af67b808c8e\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" Jul 06 14:24:55.231302 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.231286 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8d76683-c9e9-4847-a624-2af67b808c8e-metrics-cert\") pod \"lws-controller-manager-7d677d8c9-7z9vs\" (UID: \"c8d76683-c9e9-4847-a624-2af67b808c8e\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" Jul 06 14:24:55.231426 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.231404 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8d76683-c9e9-4847-a624-2af67b808c8e-cert\") pod \"lws-controller-manager-7d677d8c9-7z9vs\" (UID: \"c8d76683-c9e9-4847-a624-2af67b808c8e\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" Jul 06 14:24:55.259586 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.259531 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmlsq\" (UniqueName: \"kubernetes.io/projected/c8d76683-c9e9-4847-a624-2af67b808c8e-kube-api-access-zmlsq\") pod \"lws-controller-manager-7d677d8c9-7z9vs\" (UID: \"c8d76683-c9e9-4847-a624-2af67b808c8e\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" Jul 06 14:24:55.302179 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.302147 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" Jul 06 14:24:55.454915 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.454880 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs"] Jul 06 14:24:55.458362 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:24:55.458329 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d76683_c9e9_4847_a624_2af67b808c8e.slice/crio-edd57a2015f72706db88e9403715c030cbe80c912e8b3111851d10d6561c9e61 WatchSource:0}: Error finding container edd57a2015f72706db88e9403715c030cbe80c912e8b3111851d10d6561c9e61: Status 404 returned error can't find the container with id edd57a2015f72706db88e9403715c030cbe80c912e8b3111851d10d6561c9e61 Jul 06 14:24:55.460745 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.460725 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 14:24:55.493176 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.493139 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:55.592892 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.592855 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:55.673336 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.673252 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" event={"ID":"c8d76683-c9e9-4847-a624-2af67b808c8e","Type":"ContainerStarted","Data":"edd57a2015f72706db88e9403715c030cbe80c912e8b3111851d10d6561c9e61"} Jul 06 14:24:55.683243 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.683215 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v"] Jul 06 14:24:55.687471 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.687452 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:24:55.690463 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.690440 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 14:24:55.690619 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.690584 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gdtdc\"" Jul 06 14:24:55.690619 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.690610 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 14:24:55.690708 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.690693 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 14:24:55.690824 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.690809 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 14:24:55.700167 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.700139 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v"] Jul 06 14:24:55.833733 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.833698 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mg98\" (UniqueName: \"kubernetes.io/projected/baa3e291-464d-47ce-bb15-b0cfd33e926f-kube-api-access-7mg98\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v\" (UID: \"baa3e291-464d-47ce-bb15-b0cfd33e926f\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:24:55.833733 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.833749 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/baa3e291-464d-47ce-bb15-b0cfd33e926f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v\" (UID: \"baa3e291-464d-47ce-bb15-b0cfd33e926f\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:24:55.834005 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.833769 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/baa3e291-464d-47ce-bb15-b0cfd33e926f-manifests\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v\" (UID: \"baa3e291-464d-47ce-bb15-b0cfd33e926f\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:24:55.834005 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.833867 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baa3e291-464d-47ce-bb15-b0cfd33e926f-tmp\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v\" (UID: \"baa3e291-464d-47ce-bb15-b0cfd33e926f\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:24:55.834005 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.833911 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/baa3e291-464d-47ce-bb15-b0cfd33e926f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v\" (UID: \"baa3e291-464d-47ce-bb15-b0cfd33e926f\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:24:55.845921 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.845881 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:55.934929 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.934820 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mg98\" (UniqueName: \"kubernetes.io/projected/baa3e291-464d-47ce-bb15-b0cfd33e926f-kube-api-access-7mg98\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v\" (UID: \"baa3e291-464d-47ce-bb15-b0cfd33e926f\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:24:55.934929 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.934914 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/baa3e291-464d-47ce-bb15-b0cfd33e926f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v\" (UID: \"baa3e291-464d-47ce-bb15-b0cfd33e926f\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:24:55.935166 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.934948 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/baa3e291-464d-47ce-bb15-b0cfd33e926f-manifests\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v\" (UID: \"baa3e291-464d-47ce-bb15-b0cfd33e926f\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:24:55.935166 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.935001 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baa3e291-464d-47ce-bb15-b0cfd33e926f-tmp\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v\" (UID: \"baa3e291-464d-47ce-bb15-b0cfd33e926f\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:24:55.935166 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.935029 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/baa3e291-464d-47ce-bb15-b0cfd33e926f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v\" (UID: \"baa3e291-464d-47ce-bb15-b0cfd33e926f\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:24:55.935464 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.935442 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/baa3e291-464d-47ce-bb15-b0cfd33e926f-manifests\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v\" (UID: \"baa3e291-464d-47ce-bb15-b0cfd33e926f\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:24:55.937539 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.937508 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baa3e291-464d-47ce-bb15-b0cfd33e926f-tmp\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v\" (UID: \"baa3e291-464d-47ce-bb15-b0cfd33e926f\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:24:55.937659 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.937591 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/baa3e291-464d-47ce-bb15-b0cfd33e926f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v\" (UID: \"baa3e291-464d-47ce-bb15-b0cfd33e926f\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:24:55.937750 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.937733 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/baa3e291-464d-47ce-bb15-b0cfd33e926f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v\" (UID: \"baa3e291-464d-47ce-bb15-b0cfd33e926f\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:24:55.945877 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.945844 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:55.947821 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.947794 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mg98\" (UniqueName: \"kubernetes.io/projected/baa3e291-464d-47ce-bb15-b0cfd33e926f-kube-api-access-7mg98\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v\" (UID: \"baa3e291-464d-47ce-bb15-b0cfd33e926f\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:24:55.999220 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:55.999187 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:24:56.068885 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:56.068847 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:56.156889 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:56.156862 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v"] Jul 06 14:24:56.159615 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:24:56.159586 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa3e291_464d_47ce_bb15_b0cfd33e926f.slice/crio-5fc68bd0f283c755f921957e6e296c7a7ebb6b5242f0eae0e8ad4d36897229fc WatchSource:0}: Error finding container 5fc68bd0f283c755f921957e6e296c7a7ebb6b5242f0eae0e8ad4d36897229fc: Status 404 returned error can't find the container with id 5fc68bd0f283c755f921957e6e296c7a7ebb6b5242f0eae0e8ad4d36897229fc Jul 06 14:24:56.160001 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:56.159977 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:56.678591 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:56.678541 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" event={"ID":"baa3e291-464d-47ce-bb15-b0cfd33e926f","Type":"ContainerStarted","Data":"5fc68bd0f283c755f921957e6e296c7a7ebb6b5242f0eae0e8ad4d36897229fc"} Jul 06 14:24:57.685260 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:57.685225 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" event={"ID":"c8d76683-c9e9-4847-a624-2af67b808c8e","Type":"ContainerStarted","Data":"f796c6b3850997af6bd7832424c12b9fd31a567fd77ed7efd0ad14ec2d5dfe6a"} Jul 06 14:24:57.685801 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:57.685484 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" Jul 06 14:24:57.733243 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:57.733179 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" podStartSLOduration=2.002529376 podStartE2EDuration="3.733158584s" totalImagesPullingTime="1.730629208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:57.72914787 +0000 UTC m=+317.812441144" watchObservedRunningTime="2026-07-06 14:24:57.733158584 +0000 UTC m=+317.816451856" Jul 06 14:24:59.697174 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:24:59.697139 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" event={"ID":"baa3e291-464d-47ce-bb15-b0cfd33e926f","Type":"ContainerStarted","Data":"4d7d39f7fe28b125c11c4daf0cd3c09f33341f4b68ab3405859bb69b05925e61"} Jul 06 14:25:00.703862 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:00.703825 2582 generic.go:356] "Generic (PLEG): container finished" podID="baa3e291-464d-47ce-bb15-b0cfd33e926f" containerID="4d7d39f7fe28b125c11c4daf0cd3c09f33341f4b68ab3405859bb69b05925e61" exitCode=0 Jul 06 14:25:00.704251 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:00.703911 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" event={"ID":"baa3e291-464d-47ce-bb15-b0cfd33e926f","Type":"ContainerDied","Data":"4d7d39f7fe28b125c11c4daf0cd3c09f33341f4b68ab3405859bb69b05925e61"} Jul 06 14:25:01.711960 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:01.711922 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" event={"ID":"baa3e291-464d-47ce-bb15-b0cfd33e926f","Type":"ContainerStarted","Data":"aa0e5e4f28aad5624f1528e834066bc76721e18782dabeecbd18aa40280cac0c"} Jul 06 14:25:01.712343 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:01.712018 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:25:01.737844 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:01.737791 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" podStartSLOduration=2.226935066 podStartE2EDuration="6.737776669s" totalImagesPullingTime="3.4925666s" totalInitContainerRuntime="1.018275003s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:01.735787021 +0000 UTC m=+321.819080293" watchObservedRunningTime="2026-07-06 14:25:01.737776669 +0000 UTC m=+321.821069941" Jul 06 14:25:07.018188 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:07.018151 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:07.116167 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:07.116123 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:07.309619 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:07.309575 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:07.409197 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:07.409158 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:07.511263 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:07.511226 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:08.693445 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:08.693418 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-7z9vs" Jul 06 14:25:12.718631 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:12.718605 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v" Jul 06 14:25:14.616050 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:14.616016 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:16.439143 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:16.439110 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:25.347867 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:25.347821 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:25.812791 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:25.812748 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:26.449825 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:26.449768 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:26.623642 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:26.623610 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:26.804771 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:26.804723 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:26.965931 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:26.965892 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:27.984473 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:27.984429 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:28.115227 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:28.115192 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:28.742998 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:28.742963 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:28.850258 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:28.850220 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:30.185959 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:30.185924 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:30.436959 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:30.436873 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:33.836029 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:33.835931 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:33.955906 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:33.955870 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:35.106032 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.105997 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8"] Jul 06 14:25:35.113451 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.113430 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.117716 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.117694 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 14:25:35.118192 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.118171 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-57tz7\"" Jul 06 14:25:35.124921 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.124893 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8"] Jul 06 14:25:35.162080 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.162046 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:35.254639 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.254592 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb364d0c-b79d-45e1-8d73-6e1e3c723059-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.254639 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.254647 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb364d0c-b79d-45e1-8d73-6e1e3c723059-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.254898 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.254671 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb364d0c-b79d-45e1-8d73-6e1e3c723059-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.254898 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.254689 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf24z\" (UniqueName: \"kubernetes.io/projected/fb364d0c-b79d-45e1-8d73-6e1e3c723059-kube-api-access-cf24z\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.254898 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.254707 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb364d0c-b79d-45e1-8d73-6e1e3c723059-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.254898 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.254812 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb364d0c-b79d-45e1-8d73-6e1e3c723059-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.254898 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.254849 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb364d0c-b79d-45e1-8d73-6e1e3c723059-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.254898 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.254868 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb364d0c-b79d-45e1-8d73-6e1e3c723059-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.254898 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.254890 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb364d0c-b79d-45e1-8d73-6e1e3c723059-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.313074 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.313031 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:35.356307 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.356215 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb364d0c-b79d-45e1-8d73-6e1e3c723059-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.356307 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.356290 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb364d0c-b79d-45e1-8d73-6e1e3c723059-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.356530 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.356326 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb364d0c-b79d-45e1-8d73-6e1e3c723059-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.356530 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.356351 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf24z\" (UniqueName: \"kubernetes.io/projected/fb364d0c-b79d-45e1-8d73-6e1e3c723059-kube-api-access-cf24z\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.356530 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.356425 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb364d0c-b79d-45e1-8d73-6e1e3c723059-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.356530 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.356487 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb364d0c-b79d-45e1-8d73-6e1e3c723059-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.356530 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.356518 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb364d0c-b79d-45e1-8d73-6e1e3c723059-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.356817 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.356580 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb364d0c-b79d-45e1-8d73-6e1e3c723059-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.356817 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.356626 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb364d0c-b79d-45e1-8d73-6e1e3c723059-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.356817 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.356773 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb364d0c-b79d-45e1-8d73-6e1e3c723059-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.357071 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.357044 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb364d0c-b79d-45e1-8d73-6e1e3c723059-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.357071 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.357066 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb364d0c-b79d-45e1-8d73-6e1e3c723059-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.357297 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.357276 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb364d0c-b79d-45e1-8d73-6e1e3c723059-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.357395 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.357370 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb364d0c-b79d-45e1-8d73-6e1e3c723059-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.358907 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.358873 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb364d0c-b79d-45e1-8d73-6e1e3c723059-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.358992 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.358931 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb364d0c-b79d-45e1-8d73-6e1e3c723059-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.368600 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.368580 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb364d0c-b79d-45e1-8d73-6e1e3c723059-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.368724 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.368688 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf24z\" (UniqueName: \"kubernetes.io/projected/fb364d0c-b79d-45e1-8d73-6e1e3c723059-kube-api-access-cf24z\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4287d8\" (UID: \"fb364d0c-b79d-45e1-8d73-6e1e3c723059\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.423738 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.423706 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:35.469069 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.469030 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:35.566631 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.566601 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8"] Jul 06 14:25:35.569388 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:25:35.569359 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb364d0c_b79d_45e1_8d73_6e1e3c723059.slice/crio-6d0041074a47a90eeb1ff8ae4fd92d5f24cf425d90aa19b1cc4ed4bcb30c61f6 WatchSource:0}: Error finding container 6d0041074a47a90eeb1ff8ae4fd92d5f24cf425d90aa19b1cc4ed4bcb30c61f6: Status 404 returned error can't find the container with id 6d0041074a47a90eeb1ff8ae4fd92d5f24cf425d90aa19b1cc4ed4bcb30c61f6 Jul 06 14:25:35.863852 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:35.863814 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" event={"ID":"fb364d0c-b79d-45e1-8d73-6e1e3c723059","Type":"ContainerStarted","Data":"6d0041074a47a90eeb1ff8ae4fd92d5f24cf425d90aa19b1cc4ed4bcb30c61f6"} Jul 06 14:25:38.293218 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:38.293171 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 14:25:38.293509 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:38.293265 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 14:25:38.293509 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:38.293296 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 14:25:38.879025 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:38.878986 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" event={"ID":"fb364d0c-b79d-45e1-8d73-6e1e3c723059","Type":"ContainerStarted","Data":"bf644d99528d48053d24e258e5c5f68c4ce4b680326e345564e4ad866f76e259"} Jul 06 14:25:38.902354 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:38.902293 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" podStartSLOduration=1.180627998 podStartE2EDuration="3.902276052s" totalImagesPullingTime="2.721648054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:38.900923884 +0000 UTC m=+358.984217158" watchObservedRunningTime="2026-07-06 14:25:38.902276052 +0000 UTC m=+358.985569324" Jul 06 14:25:39.424247 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:39.424209 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:39.428520 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:39.428498 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:39.883152 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:39.883118 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:39.884036 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:39.884019 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4287d8" Jul 06 14:25:45.685731 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:45.685691 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:45.785021 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:25:45.784981 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:16.132654 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.132618 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:16.244324 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.244287 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:16.276883 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.276843 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xtfgt"] Jul 06 14:26:16.286705 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.286678 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xtfgt" Jul 06 14:26:16.289817 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.289790 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 14:26:16.291055 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.290866 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-sx88z\"" Jul 06 14:26:16.291055 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.290877 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 14:26:16.293560 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.293518 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xtfgt"] Jul 06 14:26:16.297539 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.297507 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv25v\" (UniqueName: \"kubernetes.io/projected/0b57ecc2-ebf8-4680-8893-032515a14e9f-kube-api-access-rv25v\") pod \"kuadrant-operator-catalog-xtfgt\" (UID: \"0b57ecc2-ebf8-4680-8893-032515a14e9f\") " pod="kuadrant-system/kuadrant-operator-catalog-xtfgt" Jul 06 14:26:16.351727 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.351687 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:16.398933 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.398850 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv25v\" (UniqueName: \"kubernetes.io/projected/0b57ecc2-ebf8-4680-8893-032515a14e9f-kube-api-access-rv25v\") pod \"kuadrant-operator-catalog-xtfgt\" (UID: \"0b57ecc2-ebf8-4680-8893-032515a14e9f\") " pod="kuadrant-system/kuadrant-operator-catalog-xtfgt" Jul 06 14:26:16.408542 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.408513 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv25v\" (UniqueName: \"kubernetes.io/projected/0b57ecc2-ebf8-4680-8893-032515a14e9f-kube-api-access-rv25v\") pod \"kuadrant-operator-catalog-xtfgt\" (UID: \"0b57ecc2-ebf8-4680-8893-032515a14e9f\") " pod="kuadrant-system/kuadrant-operator-catalog-xtfgt" Jul 06 14:26:16.598628 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.598585 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xtfgt" Jul 06 14:26:16.619992 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.619948 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xtfgt"] Jul 06 14:26:16.737375 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.737324 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xtfgt"] Jul 06 14:26:16.740088 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:26:16.740061 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b57ecc2_ebf8_4680_8893_032515a14e9f.slice/crio-1199bff820f5dc31d2f8916c58128a07826c16ddaead86b581b65bcb6d312246 WatchSource:0}: Error finding container 1199bff820f5dc31d2f8916c58128a07826c16ddaead86b581b65bcb6d312246: Status 404 returned error can't find the container with id 1199bff820f5dc31d2f8916c58128a07826c16ddaead86b581b65bcb6d312246 Jul 06 14:26:16.834037 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.834002 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7zqj5"] Jul 06 14:26:16.838635 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.838617 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7zqj5" Jul 06 14:26:16.845919 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.845890 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7zqj5"] Jul 06 14:26:16.902173 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:16.902088 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lwfv\" (UniqueName: \"kubernetes.io/projected/7f349558-a43c-43b8-8b18-87e23af44a47-kube-api-access-5lwfv\") pod \"kuadrant-operator-catalog-7zqj5\" (UID: \"7f349558-a43c-43b8-8b18-87e23af44a47\") " pod="kuadrant-system/kuadrant-operator-catalog-7zqj5" Jul 06 14:26:17.003106 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:17.003074 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lwfv\" (UniqueName: \"kubernetes.io/projected/7f349558-a43c-43b8-8b18-87e23af44a47-kube-api-access-5lwfv\") pod \"kuadrant-operator-catalog-7zqj5\" (UID: \"7f349558-a43c-43b8-8b18-87e23af44a47\") " pod="kuadrant-system/kuadrant-operator-catalog-7zqj5" Jul 06 14:26:17.012812 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:17.012789 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lwfv\" (UniqueName: \"kubernetes.io/projected/7f349558-a43c-43b8-8b18-87e23af44a47-kube-api-access-5lwfv\") pod \"kuadrant-operator-catalog-7zqj5\" (UID: \"7f349558-a43c-43b8-8b18-87e23af44a47\") " pod="kuadrant-system/kuadrant-operator-catalog-7zqj5" Jul 06 14:26:17.042914 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:17.042882 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xtfgt" event={"ID":"0b57ecc2-ebf8-4680-8893-032515a14e9f","Type":"ContainerStarted","Data":"1199bff820f5dc31d2f8916c58128a07826c16ddaead86b581b65bcb6d312246"} Jul 06 14:26:17.149344 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:17.149304 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7zqj5" Jul 06 14:26:17.288656 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:17.288627 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7zqj5"] Jul 06 14:26:17.290881 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:26:17.290855 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f349558_a43c_43b8_8b18_87e23af44a47.slice/crio-43cdaa3f2931cf35a98f5384d196d9eea4118cdbfda6d9a21b538d21254a52cb WatchSource:0}: Error finding container 43cdaa3f2931cf35a98f5384d196d9eea4118cdbfda6d9a21b538d21254a52cb: Status 404 returned error can't find the container with id 43cdaa3f2931cf35a98f5384d196d9eea4118cdbfda6d9a21b538d21254a52cb Jul 06 14:26:18.051258 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:18.051222 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7zqj5" event={"ID":"7f349558-a43c-43b8-8b18-87e23af44a47","Type":"ContainerStarted","Data":"43cdaa3f2931cf35a98f5384d196d9eea4118cdbfda6d9a21b538d21254a52cb"} Jul 06 14:26:19.059067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:19.059028 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7zqj5" event={"ID":"7f349558-a43c-43b8-8b18-87e23af44a47","Type":"ContainerStarted","Data":"64947bc9107d83a0ebc8be6eacffe7da578cbce881f24fe9bc26c2676bbd7296"} Jul 06 14:26:19.060667 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:19.060636 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xtfgt" event={"ID":"0b57ecc2-ebf8-4680-8893-032515a14e9f","Type":"ContainerStarted","Data":"ba193aa1754a4af80888bcaff8c9cf47d3cb9ac679a38dadf7127f021f858eae"} Jul 06 14:26:19.060808 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:19.060681 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-xtfgt" podUID="0b57ecc2-ebf8-4680-8893-032515a14e9f" containerName="registry-server" containerID="cri-o://ba193aa1754a4af80888bcaff8c9cf47d3cb9ac679a38dadf7127f021f858eae" gracePeriod=2 Jul 06 14:26:19.077318 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:19.077262 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7zqj5" podStartSLOduration=1.461741912 podStartE2EDuration="3.077241895s" totalImagesPullingTime="1.615499983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:26:19.076818049 +0000 UTC m=+399.160111315" watchObservedRunningTime="2026-07-06 14:26:19.077241895 +0000 UTC m=+399.160535168" Jul 06 14:26:19.093229 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:19.093171 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xtfgt" podStartSLOduration=0.929728425 podStartE2EDuration="3.093150105s" totalImagesPullingTime="2.16342168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:26:19.092573063 +0000 UTC m=+399.175866330" watchObservedRunningTime="2026-07-06 14:26:19.093150105 +0000 UTC m=+399.176443379" Jul 06 14:26:19.307301 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:19.307272 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xtfgt" Jul 06 14:26:19.323709 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:19.323669 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv25v\" (UniqueName: \"kubernetes.io/projected/0b57ecc2-ebf8-4680-8893-032515a14e9f-kube-api-access-rv25v\") pod \"0b57ecc2-ebf8-4680-8893-032515a14e9f\" (UID: \"0b57ecc2-ebf8-4680-8893-032515a14e9f\") " Jul 06 14:26:19.326541 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:19.326505 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b57ecc2-ebf8-4680-8893-032515a14e9f-kube-api-access-rv25v" (OuterVolumeSpecName: "kube-api-access-rv25v") pod "0b57ecc2-ebf8-4680-8893-032515a14e9f" (UID: "0b57ecc2-ebf8-4680-8893-032515a14e9f"). InnerVolumeSpecName "kube-api-access-rv25v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:26:19.424658 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:19.424542 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv25v\" (UniqueName: \"kubernetes.io/projected/0b57ecc2-ebf8-4680-8893-032515a14e9f-kube-api-access-rv25v\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:26:20.068097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:20.068057 2582 generic.go:356] "Generic (PLEG): container finished" podID="0b57ecc2-ebf8-4680-8893-032515a14e9f" containerID="ba193aa1754a4af80888bcaff8c9cf47d3cb9ac679a38dadf7127f021f858eae" exitCode=0 Jul 06 14:26:20.068589 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:20.068109 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xtfgt" Jul 06 14:26:20.068589 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:20.068147 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xtfgt" event={"ID":"0b57ecc2-ebf8-4680-8893-032515a14e9f","Type":"ContainerDied","Data":"ba193aa1754a4af80888bcaff8c9cf47d3cb9ac679a38dadf7127f021f858eae"} Jul 06 14:26:20.068589 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:20.068199 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xtfgt" event={"ID":"0b57ecc2-ebf8-4680-8893-032515a14e9f","Type":"ContainerDied","Data":"1199bff820f5dc31d2f8916c58128a07826c16ddaead86b581b65bcb6d312246"} Jul 06 14:26:20.068589 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:20.068222 2582 scope.go:117] "RemoveContainer" containerID="ba193aa1754a4af80888bcaff8c9cf47d3cb9ac679a38dadf7127f021f858eae" Jul 06 14:26:20.079520 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:20.079493 2582 scope.go:117] "RemoveContainer" containerID="ba193aa1754a4af80888bcaff8c9cf47d3cb9ac679a38dadf7127f021f858eae" Jul 06 14:26:20.079924 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:26:20.079885 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba193aa1754a4af80888bcaff8c9cf47d3cb9ac679a38dadf7127f021f858eae\": container with ID starting with ba193aa1754a4af80888bcaff8c9cf47d3cb9ac679a38dadf7127f021f858eae not found: ID does not exist" containerID="ba193aa1754a4af80888bcaff8c9cf47d3cb9ac679a38dadf7127f021f858eae" Jul 06 14:26:20.080033 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:20.079934 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba193aa1754a4af80888bcaff8c9cf47d3cb9ac679a38dadf7127f021f858eae"} err="failed to get container status \"ba193aa1754a4af80888bcaff8c9cf47d3cb9ac679a38dadf7127f021f858eae\": rpc error: code = NotFound desc = could not find container \"ba193aa1754a4af80888bcaff8c9cf47d3cb9ac679a38dadf7127f021f858eae\": container with ID starting with ba193aa1754a4af80888bcaff8c9cf47d3cb9ac679a38dadf7127f021f858eae not found: ID does not exist" Jul 06 14:26:20.093702 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:20.093670 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xtfgt"] Jul 06 14:26:20.098271 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:20.098236 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xtfgt"] Jul 06 14:26:20.412195 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:20.412168 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b57ecc2-ebf8-4680-8893-032515a14e9f" path="/var/lib/kubelet/pods/0b57ecc2-ebf8-4680-8893-032515a14e9f/volumes" Jul 06 14:26:20.924113 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:20.924069 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:20.992190 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:20.992152 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:27.149727 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:27.149683 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-7zqj5" Jul 06 14:26:27.150228 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:27.149792 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-7zqj5" Jul 06 14:26:27.173170 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:27.173141 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-7zqj5" Jul 06 14:26:28.127196 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:28.127170 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-7zqj5" Jul 06 14:26:31.469275 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:31.469242 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7"] Jul 06 14:26:31.469672 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:31.469536 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b57ecc2-ebf8-4680-8893-032515a14e9f" containerName="registry-server" Jul 06 14:26:31.469672 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:31.469563 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b57ecc2-ebf8-4680-8893-032515a14e9f" containerName="registry-server" Jul 06 14:26:31.469672 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:31.469643 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b57ecc2-ebf8-4680-8893-032515a14e9f" containerName="registry-server" Jul 06 14:26:31.473794 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:31.473773 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7" Jul 06 14:26:31.476747 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:31.476719 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7h9gg\"" Jul 06 14:26:31.483900 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:31.483876 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7"] Jul 06 14:26:31.529092 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:31.529054 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cac4035-bb0c-4007-bc7d-e4b64d3f860b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7\" (UID: \"2cac4035-bb0c-4007-bc7d-e4b64d3f860b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7" Jul 06 14:26:31.529317 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:31.529108 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4wzr\" (UniqueName: \"kubernetes.io/projected/2cac4035-bb0c-4007-bc7d-e4b64d3f860b-kube-api-access-k4wzr\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7\" (UID: \"2cac4035-bb0c-4007-bc7d-e4b64d3f860b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7" Jul 06 14:26:31.529317 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:31.529222 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cac4035-bb0c-4007-bc7d-e4b64d3f860b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7\" (UID: \"2cac4035-bb0c-4007-bc7d-e4b64d3f860b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7" Jul 06 14:26:31.630565 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:31.630517 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cac4035-bb0c-4007-bc7d-e4b64d3f860b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7\" (UID: \"2cac4035-bb0c-4007-bc7d-e4b64d3f860b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7" Jul 06 14:26:31.630765 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:31.630615 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cac4035-bb0c-4007-bc7d-e4b64d3f860b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7\" (UID: \"2cac4035-bb0c-4007-bc7d-e4b64d3f860b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7" Jul 06 14:26:31.630765 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:31.630663 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4wzr\" (UniqueName: \"kubernetes.io/projected/2cac4035-bb0c-4007-bc7d-e4b64d3f860b-kube-api-access-k4wzr\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7\" (UID: \"2cac4035-bb0c-4007-bc7d-e4b64d3f860b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7" Jul 06 14:26:31.631001 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:31.630970 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cac4035-bb0c-4007-bc7d-e4b64d3f860b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7\" (UID: \"2cac4035-bb0c-4007-bc7d-e4b64d3f860b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7" Jul 06 14:26:31.631076 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:31.630980 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cac4035-bb0c-4007-bc7d-e4b64d3f860b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7\" (UID: \"2cac4035-bb0c-4007-bc7d-e4b64d3f860b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7" Jul 06 14:26:31.640014 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:31.639980 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4wzr\" (UniqueName: \"kubernetes.io/projected/2cac4035-bb0c-4007-bc7d-e4b64d3f860b-kube-api-access-k4wzr\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7\" (UID: \"2cac4035-bb0c-4007-bc7d-e4b64d3f860b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7" Jul 06 14:26:31.782869 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:31.782840 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7" Jul 06 14:26:31.917737 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:31.917624 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7"] Jul 06 14:26:31.920471 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:26:31.920433 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cac4035_bb0c_4007_bc7d_e4b64d3f860b.slice/crio-b2d42de893d403503c5b0b3d37a4bfc6fa5c7dc0dae276040be7a7f745925cfb WatchSource:0}: Error finding container b2d42de893d403503c5b0b3d37a4bfc6fa5c7dc0dae276040be7a7f745925cfb: Status 404 returned error can't find the container with id b2d42de893d403503c5b0b3d37a4bfc6fa5c7dc0dae276040be7a7f745925cfb Jul 06 14:26:32.122659 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.122562 2582 generic.go:356] "Generic (PLEG): container finished" podID="2cac4035-bb0c-4007-bc7d-e4b64d3f860b" containerID="b92b2d5a70ca06c2dddaadcab75fd28f3587cde4aae80f5910ee3502867f2680" exitCode=0 Jul 06 14:26:32.122873 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.122660 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7" event={"ID":"2cac4035-bb0c-4007-bc7d-e4b64d3f860b","Type":"ContainerDied","Data":"b92b2d5a70ca06c2dddaadcab75fd28f3587cde4aae80f5910ee3502867f2680"} Jul 06 14:26:32.122873 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.122756 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7" event={"ID":"2cac4035-bb0c-4007-bc7d-e4b64d3f860b","Type":"ContainerStarted","Data":"b2d42de893d403503c5b0b3d37a4bfc6fa5c7dc0dae276040be7a7f745925cfb"} Jul 06 14:26:32.245742 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.245707 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v"] Jul 06 14:26:32.248942 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.248926 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" Jul 06 14:26:32.258539 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.258514 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v"] Jul 06 14:26:32.336178 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.336142 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c16f9ac0-3f2e-490d-a446-927d7e6eee88-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v\" (UID: \"c16f9ac0-3f2e-490d-a446-927d7e6eee88\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" Jul 06 14:26:32.336393 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.336207 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c16f9ac0-3f2e-490d-a446-927d7e6eee88-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v\" (UID: \"c16f9ac0-3f2e-490d-a446-927d7e6eee88\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" Jul 06 14:26:32.336393 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.336260 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdfzd\" (UniqueName: \"kubernetes.io/projected/c16f9ac0-3f2e-490d-a446-927d7e6eee88-kube-api-access-zdfzd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v\" (UID: \"c16f9ac0-3f2e-490d-a446-927d7e6eee88\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" Jul 06 14:26:32.437739 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.437649 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c16f9ac0-3f2e-490d-a446-927d7e6eee88-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v\" (UID: \"c16f9ac0-3f2e-490d-a446-927d7e6eee88\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" Jul 06 14:26:32.437739 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.437699 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c16f9ac0-3f2e-490d-a446-927d7e6eee88-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v\" (UID: \"c16f9ac0-3f2e-490d-a446-927d7e6eee88\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" Jul 06 14:26:32.437739 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.437737 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdfzd\" (UniqueName: \"kubernetes.io/projected/c16f9ac0-3f2e-490d-a446-927d7e6eee88-kube-api-access-zdfzd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v\" (UID: \"c16f9ac0-3f2e-490d-a446-927d7e6eee88\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" Jul 06 14:26:32.438108 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.438089 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c16f9ac0-3f2e-490d-a446-927d7e6eee88-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v\" (UID: \"c16f9ac0-3f2e-490d-a446-927d7e6eee88\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" Jul 06 14:26:32.438154 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.438105 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c16f9ac0-3f2e-490d-a446-927d7e6eee88-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v\" (UID: \"c16f9ac0-3f2e-490d-a446-927d7e6eee88\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" Jul 06 14:26:32.448303 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.448269 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdfzd\" (UniqueName: \"kubernetes.io/projected/c16f9ac0-3f2e-490d-a446-927d7e6eee88-kube-api-access-zdfzd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v\" (UID: \"c16f9ac0-3f2e-490d-a446-927d7e6eee88\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" Jul 06 14:26:32.558494 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.558458 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" Jul 06 14:26:32.693073 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.693049 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v"] Jul 06 14:26:32.695264 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:26:32.695230 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc16f9ac0_3f2e_490d_a446_927d7e6eee88.slice/crio-e65347b92af8b5c04a7e76de7ca80ec975f74f4893489f6d160759d8d5f48d23 WatchSource:0}: Error finding container e65347b92af8b5c04a7e76de7ca80ec975f74f4893489f6d160759d8d5f48d23: Status 404 returned error can't find the container with id e65347b92af8b5c04a7e76de7ca80ec975f74f4893489f6d160759d8d5f48d23 Jul 06 14:26:32.841388 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.841356 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp"] Jul 06 14:26:32.844650 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.844625 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" Jul 06 14:26:32.855400 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.855370 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp"] Jul 06 14:26:32.942835 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.942750 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5942e6c-f3d1-4ceb-ac3f-b5b556547c42-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp\" (UID: \"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" Jul 06 14:26:32.942835 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.942805 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkrnk\" (UniqueName: \"kubernetes.io/projected/a5942e6c-f3d1-4ceb-ac3f-b5b556547c42-kube-api-access-vkrnk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp\" (UID: \"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" Jul 06 14:26:32.942835 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:32.942834 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5942e6c-f3d1-4ceb-ac3f-b5b556547c42-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp\" (UID: \"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" Jul 06 14:26:33.043290 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.043263 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5942e6c-f3d1-4ceb-ac3f-b5b556547c42-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp\" (UID: \"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" Jul 06 14:26:33.043409 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.043322 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkrnk\" (UniqueName: \"kubernetes.io/projected/a5942e6c-f3d1-4ceb-ac3f-b5b556547c42-kube-api-access-vkrnk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp\" (UID: \"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" Jul 06 14:26:33.043409 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.043348 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5942e6c-f3d1-4ceb-ac3f-b5b556547c42-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp\" (UID: \"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" Jul 06 14:26:33.043705 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.043685 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5942e6c-f3d1-4ceb-ac3f-b5b556547c42-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp\" (UID: \"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" Jul 06 14:26:33.043779 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.043725 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5942e6c-f3d1-4ceb-ac3f-b5b556547c42-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp\" (UID: \"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" Jul 06 14:26:33.052556 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.052523 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkrnk\" (UniqueName: \"kubernetes.io/projected/a5942e6c-f3d1-4ceb-ac3f-b5b556547c42-kube-api-access-vkrnk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp\" (UID: \"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" Jul 06 14:26:33.129265 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.129233 2582 generic.go:356] "Generic (PLEG): container finished" podID="c16f9ac0-3f2e-490d-a446-927d7e6eee88" containerID="4e9d0ed494d94a4a36637a013d469257883237468a35216511bc9bfd334bacee" exitCode=0 Jul 06 14:26:33.129444 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.129328 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" event={"ID":"c16f9ac0-3f2e-490d-a446-927d7e6eee88","Type":"ContainerDied","Data":"4e9d0ed494d94a4a36637a013d469257883237468a35216511bc9bfd334bacee"} Jul 06 14:26:33.129444 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.129373 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" event={"ID":"c16f9ac0-3f2e-490d-a446-927d7e6eee88","Type":"ContainerStarted","Data":"e65347b92af8b5c04a7e76de7ca80ec975f74f4893489f6d160759d8d5f48d23"} Jul 06 14:26:33.131382 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.131363 2582 generic.go:356] "Generic (PLEG): container finished" podID="2cac4035-bb0c-4007-bc7d-e4b64d3f860b" containerID="a5bcef9ef709616e0fb883750011ba7587a2fe36dd6924efb4684ffc642ced89" exitCode=0 Jul 06 14:26:33.131472 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.131403 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7" event={"ID":"2cac4035-bb0c-4007-bc7d-e4b64d3f860b","Type":"ContainerDied","Data":"a5bcef9ef709616e0fb883750011ba7587a2fe36dd6924efb4684ffc642ced89"} Jul 06 14:26:33.163323 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.163288 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" Jul 06 14:26:33.259269 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.259234 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q"] Jul 06 14:26:33.263538 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.263513 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q" Jul 06 14:26:33.276634 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.276532 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q"] Jul 06 14:26:33.309953 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.309924 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp"] Jul 06 14:26:33.342521 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:26:33.342478 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5942e6c_f3d1_4ceb_ac3f_b5b556547c42.slice/crio-9a7574c5433fabab1b886a136d710628f77ca17ddf548fc2b9897e2099785a2f WatchSource:0}: Error finding container 9a7574c5433fabab1b886a136d710628f77ca17ddf548fc2b9897e2099785a2f: Status 404 returned error can't find the container with id 9a7574c5433fabab1b886a136d710628f77ca17ddf548fc2b9897e2099785a2f Jul 06 14:26:33.346467 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.346445 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q\" (UID: \"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q" Jul 06 14:26:33.346598 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.346482 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp84h\" (UniqueName: \"kubernetes.io/projected/d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0-kube-api-access-tp84h\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q\" (UID: \"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q" Jul 06 14:26:33.346598 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.346505 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q\" (UID: \"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q" Jul 06 14:26:33.447298 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.447268 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q\" (UID: \"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q" Jul 06 14:26:33.447440 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.447318 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp84h\" (UniqueName: \"kubernetes.io/projected/d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0-kube-api-access-tp84h\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q\" (UID: \"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q" Jul 06 14:26:33.447440 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.447351 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q\" (UID: \"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q" Jul 06 14:26:33.447658 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.447639 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q\" (UID: \"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q" Jul 06 14:26:33.447731 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.447702 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q\" (UID: \"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q" Jul 06 14:26:33.457884 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.457861 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp84h\" (UniqueName: \"kubernetes.io/projected/d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0-kube-api-access-tp84h\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q\" (UID: \"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q" Jul 06 14:26:33.579680 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.579641 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q" Jul 06 14:26:33.721957 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:33.721936 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q"] Jul 06 14:26:33.724413 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:26:33.724382 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b96ad2_08ef_4d2a_bb11_a3f904e91bf0.slice/crio-ce92784c2b9ede0860dc7af6830fd22ef572fde8e512f8facaf87afa162fb73e WatchSource:0}: Error finding container ce92784c2b9ede0860dc7af6830fd22ef572fde8e512f8facaf87afa162fb73e: Status 404 returned error can't find the container with id ce92784c2b9ede0860dc7af6830fd22ef572fde8e512f8facaf87afa162fb73e Jul 06 14:26:34.139665 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:34.139624 2582 generic.go:356] "Generic (PLEG): container finished" podID="2cac4035-bb0c-4007-bc7d-e4b64d3f860b" containerID="345af0b7650901657274f03b2275f1847c6e1410e7a4830163b8e3cf81a8f15a" exitCode=0 Jul 06 14:26:34.139826 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:34.139703 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7" event={"ID":"2cac4035-bb0c-4007-bc7d-e4b64d3f860b","Type":"ContainerDied","Data":"345af0b7650901657274f03b2275f1847c6e1410e7a4830163b8e3cf81a8f15a"} Jul 06 14:26:34.141338 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:34.141307 2582 generic.go:356] "Generic (PLEG): container finished" podID="d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0" containerID="5e559011b4364fdaa7a9e7f1f298e108f22d5f7d90596ff2069ab4c919d27611" exitCode=0 Jul 06 14:26:34.141497 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:34.141371 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q" event={"ID":"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0","Type":"ContainerDied","Data":"5e559011b4364fdaa7a9e7f1f298e108f22d5f7d90596ff2069ab4c919d27611"} Jul 06 14:26:34.141497 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:34.141413 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q" event={"ID":"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0","Type":"ContainerStarted","Data":"ce92784c2b9ede0860dc7af6830fd22ef572fde8e512f8facaf87afa162fb73e"} Jul 06 14:26:34.143496 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:34.143474 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" event={"ID":"c16f9ac0-3f2e-490d-a446-927d7e6eee88","Type":"ContainerStarted","Data":"bc5ef6a64bc1833554e71b6f6992a401100baf089d3d67781516d29ea86a38f6"} Jul 06 14:26:34.145054 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:34.145035 2582 generic.go:356] "Generic (PLEG): container finished" podID="a5942e6c-f3d1-4ceb-ac3f-b5b556547c42" containerID="81f8ffbdef316976d9009551e8363c69bd9f899ff370d188cbd3742924983c08" exitCode=0 Jul 06 14:26:34.145134 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:34.145060 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" event={"ID":"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42","Type":"ContainerDied","Data":"81f8ffbdef316976d9009551e8363c69bd9f899ff370d188cbd3742924983c08"} Jul 06 14:26:34.145134 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:34.145096 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" event={"ID":"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42","Type":"ContainerStarted","Data":"9a7574c5433fabab1b886a136d710628f77ca17ddf548fc2b9897e2099785a2f"} Jul 06 14:26:35.152828 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:35.152445 2582 generic.go:356] "Generic (PLEG): container finished" podID="d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0" containerID="b67e95da5e11debe3e0b9021801c069c8a2a001e41ce08e50a8d9689483866fb" exitCode=0 Jul 06 14:26:35.152828 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:35.152509 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q" event={"ID":"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0","Type":"ContainerDied","Data":"b67e95da5e11debe3e0b9021801c069c8a2a001e41ce08e50a8d9689483866fb"} Jul 06 14:26:35.155148 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:35.155056 2582 generic.go:356] "Generic (PLEG): container finished" podID="c16f9ac0-3f2e-490d-a446-927d7e6eee88" containerID="bc5ef6a64bc1833554e71b6f6992a401100baf089d3d67781516d29ea86a38f6" exitCode=0 Jul 06 14:26:35.155148 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:35.155095 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" event={"ID":"c16f9ac0-3f2e-490d-a446-927d7e6eee88","Type":"ContainerDied","Data":"bc5ef6a64bc1833554e71b6f6992a401100baf089d3d67781516d29ea86a38f6"} Jul 06 14:26:35.157502 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:35.157469 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" event={"ID":"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42","Type":"ContainerStarted","Data":"067b1cfa85d6c9bbf5f6a929fc427117c12863bf79bff8785a3966c6210685c2"} Jul 06 14:26:35.284890 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:35.284864 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7" Jul 06 14:26:35.366171 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:35.366133 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cac4035-bb0c-4007-bc7d-e4b64d3f860b-bundle\") pod \"2cac4035-bb0c-4007-bc7d-e4b64d3f860b\" (UID: \"2cac4035-bb0c-4007-bc7d-e4b64d3f860b\") " Jul 06 14:26:35.366357 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:35.366195 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cac4035-bb0c-4007-bc7d-e4b64d3f860b-util\") pod \"2cac4035-bb0c-4007-bc7d-e4b64d3f860b\" (UID: \"2cac4035-bb0c-4007-bc7d-e4b64d3f860b\") " Jul 06 14:26:35.366357 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:35.366251 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4wzr\" (UniqueName: \"kubernetes.io/projected/2cac4035-bb0c-4007-bc7d-e4b64d3f860b-kube-api-access-k4wzr\") pod \"2cac4035-bb0c-4007-bc7d-e4b64d3f860b\" (UID: \"2cac4035-bb0c-4007-bc7d-e4b64d3f860b\") " Jul 06 14:26:35.366785 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:35.366758 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cac4035-bb0c-4007-bc7d-e4b64d3f860b-bundle" (OuterVolumeSpecName: "bundle") pod "2cac4035-bb0c-4007-bc7d-e4b64d3f860b" (UID: "2cac4035-bb0c-4007-bc7d-e4b64d3f860b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:26:35.369296 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:35.369267 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cac4035-bb0c-4007-bc7d-e4b64d3f860b-kube-api-access-k4wzr" (OuterVolumeSpecName: "kube-api-access-k4wzr") pod "2cac4035-bb0c-4007-bc7d-e4b64d3f860b" (UID: "2cac4035-bb0c-4007-bc7d-e4b64d3f860b"). InnerVolumeSpecName "kube-api-access-k4wzr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:26:35.372344 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:35.372317 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cac4035-bb0c-4007-bc7d-e4b64d3f860b-util" (OuterVolumeSpecName: "util") pod "2cac4035-bb0c-4007-bc7d-e4b64d3f860b" (UID: "2cac4035-bb0c-4007-bc7d-e4b64d3f860b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:26:35.466982 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:35.466882 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2cac4035-bb0c-4007-bc7d-e4b64d3f860b-bundle\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:26:35.466982 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:35.466915 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2cac4035-bb0c-4007-bc7d-e4b64d3f860b-util\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:26:35.466982 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:35.466929 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4wzr\" (UniqueName: \"kubernetes.io/projected/2cac4035-bb0c-4007-bc7d-e4b64d3f860b-kube-api-access-k4wzr\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:26:36.164335 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:36.164301 2582 generic.go:356] "Generic (PLEG): container finished" podID="d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0" containerID="1f60576e2be7bd35a0234654f1b3323d8d66294d2e0e828abd2a53586a51e8a0" exitCode=0 Jul 06 14:26:36.164839 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:36.164384 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q" event={"ID":"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0","Type":"ContainerDied","Data":"1f60576e2be7bd35a0234654f1b3323d8d66294d2e0e828abd2a53586a51e8a0"} Jul 06 14:26:36.166334 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:36.166310 2582 generic.go:356] "Generic (PLEG): container finished" podID="c16f9ac0-3f2e-490d-a446-927d7e6eee88" containerID="9da3326281f29c5ae6252a5e1db2f9611d4c848d85adaf2f3dfc6c1e1e6530a1" exitCode=0 Jul 06 14:26:36.166451 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:36.166377 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" event={"ID":"c16f9ac0-3f2e-490d-a446-927d7e6eee88","Type":"ContainerDied","Data":"9da3326281f29c5ae6252a5e1db2f9611d4c848d85adaf2f3dfc6c1e1e6530a1"} Jul 06 14:26:36.168109 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:36.168087 2582 generic.go:356] "Generic (PLEG): container finished" podID="a5942e6c-f3d1-4ceb-ac3f-b5b556547c42" containerID="067b1cfa85d6c9bbf5f6a929fc427117c12863bf79bff8785a3966c6210685c2" exitCode=0 Jul 06 14:26:36.168199 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:36.168160 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" event={"ID":"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42","Type":"ContainerDied","Data":"067b1cfa85d6c9bbf5f6a929fc427117c12863bf79bff8785a3966c6210685c2"} Jul 06 14:26:36.170217 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:36.170198 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7" event={"ID":"2cac4035-bb0c-4007-bc7d-e4b64d3f860b","Type":"ContainerDied","Data":"b2d42de893d403503c5b0b3d37a4bfc6fa5c7dc0dae276040be7a7f745925cfb"} Jul 06 14:26:36.170289 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:36.170225 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7" Jul 06 14:26:36.170473 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:36.170230 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2d42de893d403503c5b0b3d37a4bfc6fa5c7dc0dae276040be7a7f745925cfb" Jul 06 14:26:37.177475 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.177441 2582 generic.go:356] "Generic (PLEG): container finished" podID="a5942e6c-f3d1-4ceb-ac3f-b5b556547c42" containerID="d8295c08c928bcbe18103602d55f75cdfc734947e3575382bff3d215a6a9c8da" exitCode=0 Jul 06 14:26:37.177908 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.177531 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" event={"ID":"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42","Type":"ContainerDied","Data":"d8295c08c928bcbe18103602d55f75cdfc734947e3575382bff3d215a6a9c8da"} Jul 06 14:26:37.318078 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.318052 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" Jul 06 14:26:37.354694 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.354661 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q" Jul 06 14:26:37.380965 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.380935 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c16f9ac0-3f2e-490d-a446-927d7e6eee88-bundle\") pod \"c16f9ac0-3f2e-490d-a446-927d7e6eee88\" (UID: \"c16f9ac0-3f2e-490d-a446-927d7e6eee88\") " Jul 06 14:26:37.381154 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.380978 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c16f9ac0-3f2e-490d-a446-927d7e6eee88-util\") pod \"c16f9ac0-3f2e-490d-a446-927d7e6eee88\" (UID: \"c16f9ac0-3f2e-490d-a446-927d7e6eee88\") " Jul 06 14:26:37.381154 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.381075 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdfzd\" (UniqueName: \"kubernetes.io/projected/c16f9ac0-3f2e-490d-a446-927d7e6eee88-kube-api-access-zdfzd\") pod \"c16f9ac0-3f2e-490d-a446-927d7e6eee88\" (UID: \"c16f9ac0-3f2e-490d-a446-927d7e6eee88\") " Jul 06 14:26:37.381508 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.381477 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c16f9ac0-3f2e-490d-a446-927d7e6eee88-bundle" (OuterVolumeSpecName: "bundle") pod "c16f9ac0-3f2e-490d-a446-927d7e6eee88" (UID: "c16f9ac0-3f2e-490d-a446-927d7e6eee88"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:26:37.383803 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.383774 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c16f9ac0-3f2e-490d-a446-927d7e6eee88-kube-api-access-zdfzd" (OuterVolumeSpecName: "kube-api-access-zdfzd") pod "c16f9ac0-3f2e-490d-a446-927d7e6eee88" (UID: "c16f9ac0-3f2e-490d-a446-927d7e6eee88"). InnerVolumeSpecName "kube-api-access-zdfzd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:26:37.387272 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.387246 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c16f9ac0-3f2e-490d-a446-927d7e6eee88-util" (OuterVolumeSpecName: "util") pod "c16f9ac0-3f2e-490d-a446-927d7e6eee88" (UID: "c16f9ac0-3f2e-490d-a446-927d7e6eee88"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:26:37.482222 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.482135 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0-bundle\") pod \"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0\" (UID: \"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0\") " Jul 06 14:26:37.482222 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.482217 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp84h\" (UniqueName: \"kubernetes.io/projected/d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0-kube-api-access-tp84h\") pod \"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0\" (UID: \"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0\") " Jul 06 14:26:37.482405 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.482250 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0-util\") pod \"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0\" (UID: \"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0\") " Jul 06 14:26:37.482789 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.482715 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c16f9ac0-3f2e-490d-a446-927d7e6eee88-bundle\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:26:37.482789 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.482745 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c16f9ac0-3f2e-490d-a446-927d7e6eee88-util\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:26:37.482789 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.482761 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdfzd\" (UniqueName: \"kubernetes.io/projected/c16f9ac0-3f2e-490d-a446-927d7e6eee88-kube-api-access-zdfzd\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:26:37.482975 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.482929 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0-bundle" (OuterVolumeSpecName: "bundle") pod "d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0" (UID: "d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:26:37.484488 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.484466 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0-kube-api-access-tp84h" (OuterVolumeSpecName: "kube-api-access-tp84h") pod "d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0" (UID: "d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0"). InnerVolumeSpecName "kube-api-access-tp84h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:26:37.487437 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.487394 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0-util" (OuterVolumeSpecName: "util") pod "d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0" (UID: "d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:26:37.583628 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.583577 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp84h\" (UniqueName: \"kubernetes.io/projected/d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0-kube-api-access-tp84h\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:26:37.583628 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.583623 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0-util\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:26:37.583628 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:37.583633 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0-bundle\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:26:38.152455 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152423 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b44758b57-x254r"] Jul 06 14:26:38.152767 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152754 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0" containerName="extract" Jul 06 14:26:38.152829 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152770 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0" containerName="extract" Jul 06 14:26:38.152829 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152784 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0" containerName="pull" Jul 06 14:26:38.152829 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152793 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0" containerName="pull" Jul 06 14:26:38.152829 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152803 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cac4035-bb0c-4007-bc7d-e4b64d3f860b" containerName="util" Jul 06 14:26:38.152829 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152808 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cac4035-bb0c-4007-bc7d-e4b64d3f860b" containerName="util" Jul 06 14:26:38.152829 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152822 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cac4035-bb0c-4007-bc7d-e4b64d3f860b" containerName="extract" Jul 06 14:26:38.152829 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152826 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cac4035-bb0c-4007-bc7d-e4b64d3f860b" containerName="extract" Jul 06 14:26:38.153019 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152832 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c16f9ac0-3f2e-490d-a446-927d7e6eee88" containerName="util" Jul 06 14:26:38.153019 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152838 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c16f9ac0-3f2e-490d-a446-927d7e6eee88" containerName="util" Jul 06 14:26:38.153019 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152844 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0" containerName="util" Jul 06 14:26:38.153019 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152848 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0" containerName="util" Jul 06 14:26:38.153019 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152853 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c16f9ac0-3f2e-490d-a446-927d7e6eee88" containerName="extract" Jul 06 14:26:38.153019 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152858 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c16f9ac0-3f2e-490d-a446-927d7e6eee88" containerName="extract" Jul 06 14:26:38.153019 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152863 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c16f9ac0-3f2e-490d-a446-927d7e6eee88" containerName="pull" Jul 06 14:26:38.153019 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152872 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c16f9ac0-3f2e-490d-a446-927d7e6eee88" containerName="pull" Jul 06 14:26:38.153019 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152880 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cac4035-bb0c-4007-bc7d-e4b64d3f860b" containerName="pull" Jul 06 14:26:38.153019 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152885 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cac4035-bb0c-4007-bc7d-e4b64d3f860b" containerName="pull" Jul 06 14:26:38.153019 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152961 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c16f9ac0-3f2e-490d-a446-927d7e6eee88" containerName="extract" Jul 06 14:26:38.153019 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152969 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0" containerName="extract" Jul 06 14:26:38.153019 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.152975 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cac4035-bb0c-4007-bc7d-e4b64d3f860b" containerName="extract" Jul 06 14:26:38.156108 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.156092 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.170905 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.170873 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b44758b57-x254r"] Jul 06 14:26:38.183613 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.183580 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q" event={"ID":"d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0","Type":"ContainerDied","Data":"ce92784c2b9ede0860dc7af6830fd22ef572fde8e512f8facaf87afa162fb73e"} Jul 06 14:26:38.184033 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.183630 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce92784c2b9ede0860dc7af6830fd22ef572fde8e512f8facaf87afa162fb73e" Jul 06 14:26:38.184033 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.183635 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q" Jul 06 14:26:38.185451 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.185421 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" event={"ID":"c16f9ac0-3f2e-490d-a446-927d7e6eee88","Type":"ContainerDied","Data":"e65347b92af8b5c04a7e76de7ca80ec975f74f4893489f6d160759d8d5f48d23"} Jul 06 14:26:38.185451 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.185440 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v" Jul 06 14:26:38.185629 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.185472 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e65347b92af8b5c04a7e76de7ca80ec975f74f4893489f6d160759d8d5f48d23" Jul 06 14:26:38.268192 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.266860 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:38.288259 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.288225 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmkv7\" (UniqueName: \"kubernetes.io/projected/5daa15e4-e27f-4749-be92-9076fc19d6b8-kube-api-access-fmkv7\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.288422 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.288335 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5daa15e4-e27f-4749-be92-9076fc19d6b8-console-serving-cert\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.288422 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.288366 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5daa15e4-e27f-4749-be92-9076fc19d6b8-console-config\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.288422 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.288390 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5daa15e4-e27f-4749-be92-9076fc19d6b8-trusted-ca-bundle\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.288422 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.288409 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5daa15e4-e27f-4749-be92-9076fc19d6b8-oauth-serving-cert\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.288622 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.288434 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5daa15e4-e27f-4749-be92-9076fc19d6b8-console-oauth-config\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.288622 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.288480 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5daa15e4-e27f-4749-be92-9076fc19d6b8-service-ca\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.328576 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.328534 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" Jul 06 14:26:38.361743 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.361708 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:38.389867 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.389831 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5942e6c-f3d1-4ceb-ac3f-b5b556547c42-util\") pod \"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42\" (UID: \"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42\") " Jul 06 14:26:38.390020 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.389894 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkrnk\" (UniqueName: \"kubernetes.io/projected/a5942e6c-f3d1-4ceb-ac3f-b5b556547c42-kube-api-access-vkrnk\") pod \"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42\" (UID: \"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42\") " Jul 06 14:26:38.390020 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.389923 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5942e6c-f3d1-4ceb-ac3f-b5b556547c42-bundle\") pod \"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42\" (UID: \"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42\") " Jul 06 14:26:38.390143 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.390025 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5daa15e4-e27f-4749-be92-9076fc19d6b8-console-serving-cert\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.390143 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.390044 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5daa15e4-e27f-4749-be92-9076fc19d6b8-console-config\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.390143 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.390059 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5daa15e4-e27f-4749-be92-9076fc19d6b8-trusted-ca-bundle\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.390143 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.390078 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5daa15e4-e27f-4749-be92-9076fc19d6b8-oauth-serving-cert\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.390143 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.390104 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5daa15e4-e27f-4749-be92-9076fc19d6b8-console-oauth-config\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.390143 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.390133 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5daa15e4-e27f-4749-be92-9076fc19d6b8-service-ca\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.390426 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.390177 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmkv7\" (UniqueName: \"kubernetes.io/projected/5daa15e4-e27f-4749-be92-9076fc19d6b8-kube-api-access-fmkv7\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.390606 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.390535 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5942e6c-f3d1-4ceb-ac3f-b5b556547c42-bundle" (OuterVolumeSpecName: "bundle") pod "a5942e6c-f3d1-4ceb-ac3f-b5b556547c42" (UID: "a5942e6c-f3d1-4ceb-ac3f-b5b556547c42"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:26:38.391190 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.391120 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5daa15e4-e27f-4749-be92-9076fc19d6b8-trusted-ca-bundle\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.391371 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.391136 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5daa15e4-e27f-4749-be92-9076fc19d6b8-oauth-serving-cert\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.391492 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.391136 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5daa15e4-e27f-4749-be92-9076fc19d6b8-console-config\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.391563 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.391520 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5daa15e4-e27f-4749-be92-9076fc19d6b8-service-ca\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.392770 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.392745 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5942e6c-f3d1-4ceb-ac3f-b5b556547c42-kube-api-access-vkrnk" (OuterVolumeSpecName: "kube-api-access-vkrnk") pod "a5942e6c-f3d1-4ceb-ac3f-b5b556547c42" (UID: "a5942e6c-f3d1-4ceb-ac3f-b5b556547c42"). InnerVolumeSpecName "kube-api-access-vkrnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:26:38.392943 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.392925 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5daa15e4-e27f-4749-be92-9076fc19d6b8-console-serving-cert\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.393002 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.392958 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5daa15e4-e27f-4749-be92-9076fc19d6b8-console-oauth-config\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.396253 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.396217 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5942e6c-f3d1-4ceb-ac3f-b5b556547c42-util" (OuterVolumeSpecName: "util") pod "a5942e6c-f3d1-4ceb-ac3f-b5b556547c42" (UID: "a5942e6c-f3d1-4ceb-ac3f-b5b556547c42"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:26:38.402794 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.402746 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmkv7\" (UniqueName: \"kubernetes.io/projected/5daa15e4-e27f-4749-be92-9076fc19d6b8-kube-api-access-fmkv7\") pod \"console-6b44758b57-x254r\" (UID: \"5daa15e4-e27f-4749-be92-9076fc19d6b8\") " pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.465222 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.465180 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:38.490659 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.490625 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkrnk\" (UniqueName: \"kubernetes.io/projected/a5942e6c-f3d1-4ceb-ac3f-b5b556547c42-kube-api-access-vkrnk\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:26:38.490659 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.490656 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5942e6c-f3d1-4ceb-ac3f-b5b556547c42-bundle\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:26:38.490844 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.490668 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5942e6c-f3d1-4ceb-ac3f-b5b556547c42-util\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:26:38.601237 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:38.601206 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b44758b57-x254r"] Jul 06 14:26:38.603151 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:26:38.603128 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5daa15e4_e27f_4749_be92_9076fc19d6b8.slice/crio-c52587826e783123765ef489dbafccd99a8c58253e27d5e6cb4b24fc572fc944 WatchSource:0}: Error finding container c52587826e783123765ef489dbafccd99a8c58253e27d5e6cb4b24fc572fc944: Status 404 returned error can't find the container with id c52587826e783123765ef489dbafccd99a8c58253e27d5e6cb4b24fc572fc944 Jul 06 14:26:39.192061 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:39.192022 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b44758b57-x254r" event={"ID":"5daa15e4-e27f-4749-be92-9076fc19d6b8","Type":"ContainerStarted","Data":"7e8621f43ef842036e5020813640a1556ea6b3ed4c97e47057221811618d52d8"} Jul 06 14:26:39.192498 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:39.192087 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b44758b57-x254r" event={"ID":"5daa15e4-e27f-4749-be92-9076fc19d6b8","Type":"ContainerStarted","Data":"c52587826e783123765ef489dbafccd99a8c58253e27d5e6cb4b24fc572fc944"} Jul 06 14:26:39.193842 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:39.193817 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" event={"ID":"a5942e6c-f3d1-4ceb-ac3f-b5b556547c42","Type":"ContainerDied","Data":"9a7574c5433fabab1b886a136d710628f77ca17ddf548fc2b9897e2099785a2f"} Jul 06 14:26:39.193930 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:39.193844 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp" Jul 06 14:26:39.193930 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:39.193855 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a7574c5433fabab1b886a136d710628f77ca17ddf548fc2b9897e2099785a2f" Jul 06 14:26:39.217400 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:39.217342 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b44758b57-x254r" podStartSLOduration=1.217326891 podStartE2EDuration="1.217326891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:26:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:26:39.214988747 +0000 UTC m=+419.298282019" watchObservedRunningTime="2026-07-06 14:26:39.217326891 +0000 UTC m=+419.300620278" Jul 06 14:26:45.521191 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:45.521153 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:48.186103 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.186069 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz"] Jul 06 14:26:48.186480 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.186363 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5942e6c-f3d1-4ceb-ac3f-b5b556547c42" containerName="extract" Jul 06 14:26:48.186480 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.186374 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5942e6c-f3d1-4ceb-ac3f-b5b556547c42" containerName="extract" Jul 06 14:26:48.186480 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.186385 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5942e6c-f3d1-4ceb-ac3f-b5b556547c42" containerName="util" Jul 06 14:26:48.186480 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.186390 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5942e6c-f3d1-4ceb-ac3f-b5b556547c42" containerName="util" Jul 06 14:26:48.186480 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.186401 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5942e6c-f3d1-4ceb-ac3f-b5b556547c42" containerName="pull" Jul 06 14:26:48.186480 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.186406 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5942e6c-f3d1-4ceb-ac3f-b5b556547c42" containerName="pull" Jul 06 14:26:48.186480 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.186455 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5942e6c-f3d1-4ceb-ac3f-b5b556547c42" containerName="extract" Jul 06 14:26:48.191049 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.191031 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz" Jul 06 14:26:48.194710 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.194688 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6cpnc\"" Jul 06 14:26:48.211106 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.211081 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz"] Jul 06 14:26:48.276797 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.276711 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd4nz\" (UniqueName: \"kubernetes.io/projected/71e66fc3-3242-4af3-8db8-2f0911b176a2-kube-api-access-vd4nz\") pod \"limitador-operator-controller-manager-859d7b78bd-vfwwz\" (UID: \"71e66fc3-3242-4af3-8db8-2f0911b176a2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz" Jul 06 14:26:48.378213 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.378176 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd4nz\" (UniqueName: \"kubernetes.io/projected/71e66fc3-3242-4af3-8db8-2f0911b176a2-kube-api-access-vd4nz\") pod \"limitador-operator-controller-manager-859d7b78bd-vfwwz\" (UID: \"71e66fc3-3242-4af3-8db8-2f0911b176a2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz" Jul 06 14:26:48.390535 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.390502 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd4nz\" (UniqueName: \"kubernetes.io/projected/71e66fc3-3242-4af3-8db8-2f0911b176a2-kube-api-access-vd4nz\") pod \"limitador-operator-controller-manager-859d7b78bd-vfwwz\" (UID: \"71e66fc3-3242-4af3-8db8-2f0911b176a2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz" Jul 06 14:26:48.466008 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.465866 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:48.466008 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.465925 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:48.471154 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.471129 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:48.500678 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.500654 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz" Jul 06 14:26:48.638948 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:48.638918 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz"] Jul 06 14:26:48.642496 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:26:48.642473 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71e66fc3_3242_4af3_8db8_2f0911b176a2.slice/crio-71a71e187c7657bb232c3988897752a3b7fdec66aaf7086ad8a1d16b2cc2e754 WatchSource:0}: Error finding container 71a71e187c7657bb232c3988897752a3b7fdec66aaf7086ad8a1d16b2cc2e754: Status 404 returned error can't find the container with id 71a71e187c7657bb232c3988897752a3b7fdec66aaf7086ad8a1d16b2cc2e754 Jul 06 14:26:49.126245 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:49.126210 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:49.251613 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:49.251576 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz" event={"ID":"71e66fc3-3242-4af3-8db8-2f0911b176a2","Type":"ContainerStarted","Data":"71a71e187c7657bb232c3988897752a3b7fdec66aaf7086ad8a1d16b2cc2e754"} Jul 06 14:26:49.255903 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:49.255859 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b44758b57-x254r" Jul 06 14:26:49.414020 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:49.413945 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b65f45b5-xqbbs"] Jul 06 14:26:49.654383 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:49.654343 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:49.905526 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:49.905482 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:51.264688 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:51.264655 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz" event={"ID":"71e66fc3-3242-4af3-8db8-2f0911b176a2","Type":"ContainerStarted","Data":"63927a6ed59c53525e5058484228b50d47a86ca7728849bf0ca038da60dac854"} Jul 06 14:26:51.265090 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:51.264784 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz" Jul 06 14:26:51.285845 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:51.285800 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz" podStartSLOduration=1.465389568 podStartE2EDuration="3.285786582s" totalImagesPullingTime="1.820397014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:26:51.28371156 +0000 UTC m=+431.367004833" watchObservedRunningTime="2026-07-06 14:26:51.285786582 +0000 UTC m=+431.369079854" Jul 06 14:26:54.904345 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:54.904312 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:55.700879 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:55.700842 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:56.090280 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:56.090243 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:58.201911 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:58.201871 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:58.916769 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:58.916740 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qm7qh"] Jul 06 14:26:58.921841 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:58.921825 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qm7qh" Jul 06 14:26:58.924519 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:58.924497 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5md2g\"" Jul 06 14:26:58.930040 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:58.930019 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qm7qh"] Jul 06 14:26:59.073038 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:59.072999 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prxc2\" (UniqueName: \"kubernetes.io/projected/db41a88c-9883-4c29-b5db-f06a9ee5920d-kube-api-access-prxc2\") pod \"authorino-operator-75cc8d5cb7-qm7qh\" (UID: \"db41a88c-9883-4c29-b5db-f06a9ee5920d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qm7qh" Jul 06 14:26:59.174412 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:59.174322 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prxc2\" (UniqueName: \"kubernetes.io/projected/db41a88c-9883-4c29-b5db-f06a9ee5920d-kube-api-access-prxc2\") pod \"authorino-operator-75cc8d5cb7-qm7qh\" (UID: \"db41a88c-9883-4c29-b5db-f06a9ee5920d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qm7qh" Jul 06 14:26:59.183723 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:59.183690 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prxc2\" (UniqueName: \"kubernetes.io/projected/db41a88c-9883-4c29-b5db-f06a9ee5920d-kube-api-access-prxc2\") pod \"authorino-operator-75cc8d5cb7-qm7qh\" (UID: \"db41a88c-9883-4c29-b5db-f06a9ee5920d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qm7qh" Jul 06 14:26:59.232811 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:59.232770 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qm7qh" Jul 06 14:26:59.391927 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:26:59.391900 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qm7qh"] Jul 06 14:26:59.394191 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:26:59.394165 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb41a88c_9883_4c29_b5db_f06a9ee5920d.slice/crio-25d0bfda2e1b9505916996a33cf9729d00df8d8a97b95590ee23cde6ea77b2a3 WatchSource:0}: Error finding container 25d0bfda2e1b9505916996a33cf9729d00df8d8a97b95590ee23cde6ea77b2a3: Status 404 returned error can't find the container with id 25d0bfda2e1b9505916996a33cf9729d00df8d8a97b95590ee23cde6ea77b2a3 Jul 06 14:27:00.295594 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:00.295536 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:00.312817 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:00.312651 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qm7qh" event={"ID":"db41a88c-9883-4c29-b5db-f06a9ee5920d","Type":"ContainerStarted","Data":"25d0bfda2e1b9505916996a33cf9729d00df8d8a97b95590ee23cde6ea77b2a3"} Jul 06 14:27:02.272529 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:02.272454 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz" Jul 06 14:27:02.326531 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:02.326501 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qm7qh" event={"ID":"db41a88c-9883-4c29-b5db-f06a9ee5920d","Type":"ContainerStarted","Data":"3652b409df27a9eab1df3a6fd61daab94b372d11a237f0cbcdf34091c24e2d18"} Jul 06 14:27:02.326754 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:02.326735 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qm7qh" Jul 06 14:27:02.350369 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:02.350318 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qm7qh" podStartSLOduration=2.237355239 podStartE2EDuration="4.350303693s" totalImagesPullingTime="2.112948454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:27:02.348813535 +0000 UTC m=+442.432106808" watchObservedRunningTime="2026-07-06 14:27:02.350303693 +0000 UTC m=+442.433597037" Jul 06 14:27:03.541713 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:03.541674 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:03.953394 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:03.953295 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:05.119020 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:05.118989 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:05.220000 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:05.219958 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:05.318383 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:05.318346 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:07.868991 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:07.868948 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:09.328940 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:09.328902 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:09.420337 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:09.420289 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:09.560974 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:09.560937 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:13.334998 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:13.334967 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qm7qh" Jul 06 14:27:14.210561 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.210519 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz"] Jul 06 14:27:14.210751 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.210731 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz" podUID="71e66fc3-3242-4af3-8db8-2f0911b176a2" containerName="manager" containerID="cri-o://63927a6ed59c53525e5058484228b50d47a86ca7728849bf0ca038da60dac854" gracePeriod=2 Jul 06 14:27:14.229524 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.229500 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz"] Jul 06 14:27:14.357757 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.356864 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j"] Jul 06 14:27:14.357757 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.357308 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71e66fc3-3242-4af3-8db8-2f0911b176a2" containerName="manager" Jul 06 14:27:14.357757 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.357324 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="71e66fc3-3242-4af3-8db8-2f0911b176a2" containerName="manager" Jul 06 14:27:14.357757 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.357410 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="71e66fc3-3242-4af3-8db8-2f0911b176a2" containerName="manager" Jul 06 14:27:14.360397 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.360380 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j" Jul 06 14:27:14.364767 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:27:14.364741 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vfwwz\" is forbidden: User \"system:node:ip-10-0-136-208.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-208.ec2.internal' and this object" podUID="71e66fc3-3242-4af3-8db8-2f0911b176a2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz" Jul 06 14:27:14.367105 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.366990 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-psqvr\"" Jul 06 14:27:14.383921 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.383896 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j"] Jul 06 14:27:14.387741 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.387712 2582 generic.go:356] "Generic (PLEG): container finished" podID="71e66fc3-3242-4af3-8db8-2f0911b176a2" containerID="63927a6ed59c53525e5058484228b50d47a86ca7728849bf0ca038da60dac854" exitCode=0 Jul 06 14:27:14.397393 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.397367 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/068ec0ba-6c81-416a-ba87-976180cd1517-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jdj5j\" (UID: \"068ec0ba-6c81-416a-ba87-976180cd1517\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j" Jul 06 14:27:14.397503 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.397396 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gjwk\" (UniqueName: \"kubernetes.io/projected/068ec0ba-6c81-416a-ba87-976180cd1517-kube-api-access-5gjwk\") pod \"kuadrant-operator-controller-manager-86878c769f-jdj5j\" (UID: \"068ec0ba-6c81-416a-ba87-976180cd1517\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j" Jul 06 14:27:14.466422 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.466371 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz" Jul 06 14:27:14.498128 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.498105 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/068ec0ba-6c81-416a-ba87-976180cd1517-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jdj5j\" (UID: \"068ec0ba-6c81-416a-ba87-976180cd1517\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j" Jul 06 14:27:14.498242 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.498130 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gjwk\" (UniqueName: \"kubernetes.io/projected/068ec0ba-6c81-416a-ba87-976180cd1517-kube-api-access-5gjwk\") pod \"kuadrant-operator-controller-manager-86878c769f-jdj5j\" (UID: \"068ec0ba-6c81-416a-ba87-976180cd1517\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j" Jul 06 14:27:14.498410 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.498394 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/068ec0ba-6c81-416a-ba87-976180cd1517-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jdj5j\" (UID: \"068ec0ba-6c81-416a-ba87-976180cd1517\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j" Jul 06 14:27:14.511203 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.511184 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gjwk\" (UniqueName: \"kubernetes.io/projected/068ec0ba-6c81-416a-ba87-976180cd1517-kube-api-access-5gjwk\") pod \"kuadrant-operator-controller-manager-86878c769f-jdj5j\" (UID: \"068ec0ba-6c81-416a-ba87-976180cd1517\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j" Jul 06 14:27:14.599247 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.599227 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vd4nz\" (UniqueName: \"kubernetes.io/projected/71e66fc3-3242-4af3-8db8-2f0911b176a2-kube-api-access-vd4nz\") pod \"71e66fc3-3242-4af3-8db8-2f0911b176a2\" (UID: \"71e66fc3-3242-4af3-8db8-2f0911b176a2\") " Jul 06 14:27:14.601138 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.601111 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71e66fc3-3242-4af3-8db8-2f0911b176a2-kube-api-access-vd4nz" (OuterVolumeSpecName: "kube-api-access-vd4nz") pod "71e66fc3-3242-4af3-8db8-2f0911b176a2" (UID: "71e66fc3-3242-4af3-8db8-2f0911b176a2"). InnerVolumeSpecName "kube-api-access-vd4nz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:27:14.671108 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.671089 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j" Jul 06 14:27:14.700206 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.700187 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vd4nz\" (UniqueName: \"kubernetes.io/projected/71e66fc3-3242-4af3-8db8-2f0911b176a2-kube-api-access-vd4nz\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:27:14.805991 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:14.805959 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j"] Jul 06 14:27:14.809143 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:27:14.809120 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod068ec0ba_6c81_416a_ba87_976180cd1517.slice/crio-faadc8c351d069a41aacad7138775f1b465cab9c67e4cd2b1007c0e7a024518c WatchSource:0}: Error finding container faadc8c351d069a41aacad7138775f1b465cab9c67e4cd2b1007c0e7a024518c: Status 404 returned error can't find the container with id faadc8c351d069a41aacad7138775f1b465cab9c67e4cd2b1007c0e7a024518c Jul 06 14:27:15.279479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.279440 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8b65f45b5-xqbbs" podUID="426d6a77-19e0-4503-8194-1d64dd724351" containerName="console" containerID="cri-o://6332511ebfb322b4563ca81a8f267222fe53f94f2ce49c5a26a0b0e867de4a2d" gracePeriod=15 Jul 06 14:27:15.396502 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.396472 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vfwwz" Jul 06 14:27:15.396913 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.396525 2582 scope.go:117] "RemoveContainer" containerID="63927a6ed59c53525e5058484228b50d47a86ca7728849bf0ca038da60dac854" Jul 06 14:27:15.398692 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.398665 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j" event={"ID":"068ec0ba-6c81-416a-ba87-976180cd1517","Type":"ContainerStarted","Data":"faadc8c351d069a41aacad7138775f1b465cab9c67e4cd2b1007c0e7a024518c"} Jul 06 14:27:15.531125 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.531108 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:27:15.605012 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.604978 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-trusted-ca-bundle\") pod \"426d6a77-19e0-4503-8194-1d64dd724351\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " Jul 06 14:27:15.605187 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.605035 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-oauth-serving-cert\") pod \"426d6a77-19e0-4503-8194-1d64dd724351\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " Jul 06 14:27:15.605187 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.605068 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/426d6a77-19e0-4503-8194-1d64dd724351-console-serving-cert\") pod \"426d6a77-19e0-4503-8194-1d64dd724351\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " Jul 06 14:27:15.605187 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.605159 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-console-config\") pod \"426d6a77-19e0-4503-8194-1d64dd724351\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " Jul 06 14:27:15.605368 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.605226 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-service-ca\") pod \"426d6a77-19e0-4503-8194-1d64dd724351\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " Jul 06 14:27:15.605368 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.605262 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/426d6a77-19e0-4503-8194-1d64dd724351-console-oauth-config\") pod \"426d6a77-19e0-4503-8194-1d64dd724351\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " Jul 06 14:27:15.605368 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.605314 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8xdg\" (UniqueName: \"kubernetes.io/projected/426d6a77-19e0-4503-8194-1d64dd724351-kube-api-access-m8xdg\") pod \"426d6a77-19e0-4503-8194-1d64dd724351\" (UID: \"426d6a77-19e0-4503-8194-1d64dd724351\") " Jul 06 14:27:15.605517 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.605423 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "426d6a77-19e0-4503-8194-1d64dd724351" (UID: "426d6a77-19e0-4503-8194-1d64dd724351"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:27:15.605955 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.605928 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "426d6a77-19e0-4503-8194-1d64dd724351" (UID: "426d6a77-19e0-4503-8194-1d64dd724351"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:27:15.606236 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.606214 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-trusted-ca-bundle\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:27:15.606392 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.606367 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-service-ca" (OuterVolumeSpecName: "service-ca") pod "426d6a77-19e0-4503-8194-1d64dd724351" (UID: "426d6a77-19e0-4503-8194-1d64dd724351"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:27:15.608155 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.608120 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/426d6a77-19e0-4503-8194-1d64dd724351-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "426d6a77-19e0-4503-8194-1d64dd724351" (UID: "426d6a77-19e0-4503-8194-1d64dd724351"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:27:15.608260 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.608228 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-console-config" (OuterVolumeSpecName: "console-config") pod "426d6a77-19e0-4503-8194-1d64dd724351" (UID: "426d6a77-19e0-4503-8194-1d64dd724351"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:27:15.608531 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.608503 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/426d6a77-19e0-4503-8194-1d64dd724351-kube-api-access-m8xdg" (OuterVolumeSpecName: "kube-api-access-m8xdg") pod "426d6a77-19e0-4503-8194-1d64dd724351" (UID: "426d6a77-19e0-4503-8194-1d64dd724351"). InnerVolumeSpecName "kube-api-access-m8xdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:27:15.612592 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.611178 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/426d6a77-19e0-4503-8194-1d64dd724351-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "426d6a77-19e0-4503-8194-1d64dd724351" (UID: "426d6a77-19e0-4503-8194-1d64dd724351"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:27:15.706757 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.706725 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-service-ca\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:27:15.706757 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.706755 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/426d6a77-19e0-4503-8194-1d64dd724351-console-oauth-config\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:27:15.706757 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.706765 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8xdg\" (UniqueName: \"kubernetes.io/projected/426d6a77-19e0-4503-8194-1d64dd724351-kube-api-access-m8xdg\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:27:15.707000 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.706774 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-oauth-serving-cert\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:27:15.707000 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.706782 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/426d6a77-19e0-4503-8194-1d64dd724351-console-serving-cert\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:27:15.707000 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:15.706790 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/426d6a77-19e0-4503-8194-1d64dd724351-console-config\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:27:16.404251 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:16.404218 2582 generic.go:356] "Generic (PLEG): container finished" podID="426d6a77-19e0-4503-8194-1d64dd724351" containerID="6332511ebfb322b4563ca81a8f267222fe53f94f2ce49c5a26a0b0e867de4a2d" exitCode=0 Jul 06 14:27:16.404691 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:16.404336 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b65f45b5-xqbbs" Jul 06 14:27:16.404691 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:16.404335 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b65f45b5-xqbbs" event={"ID":"426d6a77-19e0-4503-8194-1d64dd724351","Type":"ContainerDied","Data":"6332511ebfb322b4563ca81a8f267222fe53f94f2ce49c5a26a0b0e867de4a2d"} Jul 06 14:27:16.404691 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:16.404485 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b65f45b5-xqbbs" event={"ID":"426d6a77-19e0-4503-8194-1d64dd724351","Type":"ContainerDied","Data":"53503b66788a41be0ce99ff8043710f2d674329809bff154071ba5da30507d1b"} Jul 06 14:27:16.404691 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:16.404520 2582 scope.go:117] "RemoveContainer" containerID="6332511ebfb322b4563ca81a8f267222fe53f94f2ce49c5a26a0b0e867de4a2d" Jul 06 14:27:16.413639 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:16.413618 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71e66fc3-3242-4af3-8db8-2f0911b176a2" path="/var/lib/kubelet/pods/71e66fc3-3242-4af3-8db8-2f0911b176a2/volumes" Jul 06 14:27:16.413639 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:16.413630 2582 scope.go:117] "RemoveContainer" containerID="6332511ebfb322b4563ca81a8f267222fe53f94f2ce49c5a26a0b0e867de4a2d" Jul 06 14:27:16.413866 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:27:16.413849 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6332511ebfb322b4563ca81a8f267222fe53f94f2ce49c5a26a0b0e867de4a2d\": container with ID starting with 6332511ebfb322b4563ca81a8f267222fe53f94f2ce49c5a26a0b0e867de4a2d not found: ID does not exist" containerID="6332511ebfb322b4563ca81a8f267222fe53f94f2ce49c5a26a0b0e867de4a2d" Jul 06 14:27:16.413907 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:16.413873 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6332511ebfb322b4563ca81a8f267222fe53f94f2ce49c5a26a0b0e867de4a2d"} err="failed to get container status \"6332511ebfb322b4563ca81a8f267222fe53f94f2ce49c5a26a0b0e867de4a2d\": rpc error: code = NotFound desc = could not find container \"6332511ebfb322b4563ca81a8f267222fe53f94f2ce49c5a26a0b0e867de4a2d\": container with ID starting with 6332511ebfb322b4563ca81a8f267222fe53f94f2ce49c5a26a0b0e867de4a2d not found: ID does not exist" Jul 06 14:27:16.441680 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:16.441632 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b65f45b5-xqbbs"] Jul 06 14:27:16.452494 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:16.452461 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8b65f45b5-xqbbs"] Jul 06 14:27:18.413962 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:18.413920 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="426d6a77-19e0-4503-8194-1d64dd724351" path="/var/lib/kubelet/pods/426d6a77-19e0-4503-8194-1d64dd724351/volumes" Jul 06 14:27:18.878629 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:18.878588 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:19.133923 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:19.133832 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:20.428818 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:20.428787 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j" event={"ID":"068ec0ba-6c81-416a-ba87-976180cd1517","Type":"ContainerStarted","Data":"dc7cbc0fdd17ff65d617ec174549126d3f3a7651505889517ee93db94c5a9ddf"} Jul 06 14:27:20.429171 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:20.428870 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j" Jul 06 14:27:21.248540 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:21.248503 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:21.354682 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:21.354643 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:25.653080 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:25.653042 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:25.741669 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:25.741586 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:28.088418 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:28.088375 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:28.272138 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:28.272105 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:31.436412 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:31.436385 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j" Jul 06 14:27:31.466127 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:31.466078 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j" podStartSLOduration=12.31002442 podStartE2EDuration="17.466063386s" totalImagesPullingTime="5.156038966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:27:20.475669373 +0000 UTC m=+460.558962647" watchObservedRunningTime="2026-07-06 14:27:31.466063386 +0000 UTC m=+471.549356659" Jul 06 14:27:36.974333 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:36.974300 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:37.104261 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:37.104225 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:39.368295 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:39.368253 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:39.456206 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:39.456168 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:43.891899 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:43.891843 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:44.199675 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:44.199579 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:44.737029 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:44.736993 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:47.467677 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:47.467629 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:47.577242 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:47.577207 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:47.782018 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:47.781986 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:48.012292 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:48.012252 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:48.137421 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:48.137329 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:53.432843 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:53.432808 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:53.526783 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:53.526747 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:53.587869 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:53.587829 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:53.904234 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:53.904201 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:27:53.904575 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:53.904562 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="426d6a77-19e0-4503-8194-1d64dd724351" containerName="console" Jul 06 14:27:53.904628 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:53.904577 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="426d6a77-19e0-4503-8194-1d64dd724351" containerName="console" Jul 06 14:27:53.904659 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:53.904645 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="426d6a77-19e0-4503-8194-1d64dd724351" containerName="console" Jul 06 14:27:53.908762 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:53.908737 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dg5sb" Jul 06 14:27:53.911626 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:53.911603 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7h9gg\"" Jul 06 14:27:53.911761 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:53.911603 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 14:27:53.921442 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:53.921409 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:27:53.947791 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:53.947756 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:27:54.036953 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.036896 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w64sc\" (UniqueName: \"kubernetes.io/projected/d529667d-8e38-4e94-8502-a556f288ca60-kube-api-access-w64sc\") pod \"limitador-limitador-54d6d988d5-dg5sb\" (UID: \"d529667d-8e38-4e94-8502-a556f288ca60\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dg5sb" Jul 06 14:27:54.037142 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.037008 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d529667d-8e38-4e94-8502-a556f288ca60-config-file\") pod \"limitador-limitador-54d6d988d5-dg5sb\" (UID: \"d529667d-8e38-4e94-8502-a556f288ca60\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dg5sb" Jul 06 14:27:54.138411 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.138370 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w64sc\" (UniqueName: \"kubernetes.io/projected/d529667d-8e38-4e94-8502-a556f288ca60-kube-api-access-w64sc\") pod \"limitador-limitador-54d6d988d5-dg5sb\" (UID: \"d529667d-8e38-4e94-8502-a556f288ca60\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dg5sb" Jul 06 14:27:54.138626 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.138430 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d529667d-8e38-4e94-8502-a556f288ca60-config-file\") pod \"limitador-limitador-54d6d988d5-dg5sb\" (UID: \"d529667d-8e38-4e94-8502-a556f288ca60\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dg5sb" Jul 06 14:27:54.139055 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.139037 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d529667d-8e38-4e94-8502-a556f288ca60-config-file\") pod \"limitador-limitador-54d6d988d5-dg5sb\" (UID: \"d529667d-8e38-4e94-8502-a556f288ca60\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dg5sb" Jul 06 14:27:54.147710 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.147688 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w64sc\" (UniqueName: \"kubernetes.io/projected/d529667d-8e38-4e94-8502-a556f288ca60-kube-api-access-w64sc\") pod \"limitador-limitador-54d6d988d5-dg5sb\" (UID: \"d529667d-8e38-4e94-8502-a556f288ca60\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dg5sb" Jul 06 14:27:54.223140 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.223057 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dg5sb" Jul 06 14:27:54.232147 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.232118 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-jrl6w"] Jul 06 14:27:54.234453 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.234434 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jrl6w" Jul 06 14:27:54.237230 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.237210 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6h22t\"" Jul 06 14:27:54.244664 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.244636 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jrl6w"] Jul 06 14:27:54.265932 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.265892 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:54.340219 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.340178 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh95t\" (UniqueName: \"kubernetes.io/projected/1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5-kube-api-access-rh95t\") pod \"authorino-58cd955675-jrl6w\" (UID: \"1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5\") " pod="kuadrant-system/authorino-58cd955675-jrl6w" Jul 06 14:27:54.365886 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.365862 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:27:54.366644 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:27:54.366605 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd529667d_8e38_4e94_8502_a556f288ca60.slice/crio-6a0882aa9536c1d99bef46a36c8a8d4032da8763c411cdeb14b2b779d80f8aa7 WatchSource:0}: Error finding container 6a0882aa9536c1d99bef46a36c8a8d4032da8763c411cdeb14b2b779d80f8aa7: Status 404 returned error can't find the container with id 6a0882aa9536c1d99bef46a36c8a8d4032da8763c411cdeb14b2b779d80f8aa7 Jul 06 14:27:54.378131 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.378107 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:54.441703 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.441668 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh95t\" (UniqueName: \"kubernetes.io/projected/1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5-kube-api-access-rh95t\") pod \"authorino-58cd955675-jrl6w\" (UID: \"1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5\") " pod="kuadrant-system/authorino-58cd955675-jrl6w" Jul 06 14:27:54.455736 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.455701 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh95t\" (UniqueName: \"kubernetes.io/projected/1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5-kube-api-access-rh95t\") pod \"authorino-58cd955675-jrl6w\" (UID: \"1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5\") " pod="kuadrant-system/authorino-58cd955675-jrl6w" Jul 06 14:27:54.556811 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.556778 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jrl6w" Jul 06 14:27:54.599055 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.599020 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dg5sb" event={"ID":"d529667d-8e38-4e94-8502-a556f288ca60","Type":"ContainerStarted","Data":"6a0882aa9536c1d99bef46a36c8a8d4032da8763c411cdeb14b2b779d80f8aa7"} Jul 06 14:27:54.690074 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:54.690047 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jrl6w"] Jul 06 14:27:54.692024 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:27:54.691999 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ef6f2e3_ef2c_40e2_85ab_ca690801ddd5.slice/crio-8fbc1cf7c0f1b656f0332156989acd34cbdf9fe4fefc7f962921f7f418903599 WatchSource:0}: Error finding container 8fbc1cf7c0f1b656f0332156989acd34cbdf9fe4fefc7f962921f7f418903599: Status 404 returned error can't find the container with id 8fbc1cf7c0f1b656f0332156989acd34cbdf9fe4fefc7f962921f7f418903599 Jul 06 14:27:55.611521 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:55.611453 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jrl6w" event={"ID":"1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5","Type":"ContainerStarted","Data":"8fbc1cf7c0f1b656f0332156989acd34cbdf9fe4fefc7f962921f7f418903599"} Jul 06 14:27:56.478016 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:56.477969 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:56.581877 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:56.581848 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:57.072192 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:57.072151 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:57.173435 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:57.173301 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:58.987816 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:58.987730 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jrl6w"] Jul 06 14:27:59.635774 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:59.635735 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jrl6w" event={"ID":"1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5","Type":"ContainerStarted","Data":"c817fa7115dfa275a27b221f4a59c188ad7fa57e98118fd2e67ae7ecdab06b74"} Jul 06 14:27:59.637146 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:59.637122 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dg5sb" event={"ID":"d529667d-8e38-4e94-8502-a556f288ca60","Type":"ContainerStarted","Data":"9a94761f2bbe9aa0eab1fdeef57fcb255dc98336cb07361f684b9d68f7700bc6"} Jul 06 14:27:59.637285 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:59.637193 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dg5sb" Jul 06 14:27:59.658566 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:59.655239 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-jrl6w" podStartSLOduration=1.744372774 podStartE2EDuration="5.65520892s" totalImagesPullingTime="3.910836146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:27:59.652954679 +0000 UTC m=+499.736247953" watchObservedRunningTime="2026-07-06 14:27:59.65520892 +0000 UTC m=+499.738502184" Jul 06 14:27:59.676788 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:27:59.676732 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-dg5sb" podStartSLOduration=2.448478292 podStartE2EDuration="6.676715803s" totalImagesPullingTime="4.228237511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:27:59.676124827 +0000 UTC m=+499.759418098" watchObservedRunningTime="2026-07-06 14:27:59.676715803 +0000 UTC m=+499.760009076" Jul 06 14:28:00.075444 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:00.075407 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:00.181217 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:00.181175 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:00.641667 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:00.641626 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-jrl6w" podUID="1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5" containerName="authorino" containerID="cri-o://c817fa7115dfa275a27b221f4a59c188ad7fa57e98118fd2e67ae7ecdab06b74" gracePeriod=30 Jul 06 14:28:00.886000 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:00.885977 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jrl6w" Jul 06 14:28:01.005339 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:01.005246 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rh95t\" (UniqueName: \"kubernetes.io/projected/1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5-kube-api-access-rh95t\") pod \"1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5\" (UID: \"1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5\") " Jul 06 14:28:01.007393 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:01.007369 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5-kube-api-access-rh95t" (OuterVolumeSpecName: "kube-api-access-rh95t") pod "1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5" (UID: "1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5"). InnerVolumeSpecName "kube-api-access-rh95t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:28:01.106507 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:01.106458 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh95t\" (UniqueName: \"kubernetes.io/projected/1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5-kube-api-access-rh95t\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:28:01.647588 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:01.647534 2582 generic.go:356] "Generic (PLEG): container finished" podID="1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5" containerID="c817fa7115dfa275a27b221f4a59c188ad7fa57e98118fd2e67ae7ecdab06b74" exitCode=0 Jul 06 14:28:01.647588 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:01.647592 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jrl6w" Jul 06 14:28:01.647809 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:01.647632 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jrl6w" event={"ID":"1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5","Type":"ContainerDied","Data":"c817fa7115dfa275a27b221f4a59c188ad7fa57e98118fd2e67ae7ecdab06b74"} Jul 06 14:28:01.647809 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:01.647677 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jrl6w" event={"ID":"1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5","Type":"ContainerDied","Data":"8fbc1cf7c0f1b656f0332156989acd34cbdf9fe4fefc7f962921f7f418903599"} Jul 06 14:28:01.647809 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:01.647698 2582 scope.go:117] "RemoveContainer" containerID="c817fa7115dfa275a27b221f4a59c188ad7fa57e98118fd2e67ae7ecdab06b74" Jul 06 14:28:01.656700 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:01.656684 2582 scope.go:117] "RemoveContainer" containerID="c817fa7115dfa275a27b221f4a59c188ad7fa57e98118fd2e67ae7ecdab06b74" Jul 06 14:28:01.656959 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:28:01.656941 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c817fa7115dfa275a27b221f4a59c188ad7fa57e98118fd2e67ae7ecdab06b74\": container with ID starting with c817fa7115dfa275a27b221f4a59c188ad7fa57e98118fd2e67ae7ecdab06b74 not found: ID does not exist" containerID="c817fa7115dfa275a27b221f4a59c188ad7fa57e98118fd2e67ae7ecdab06b74" Jul 06 14:28:01.657009 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:01.656968 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c817fa7115dfa275a27b221f4a59c188ad7fa57e98118fd2e67ae7ecdab06b74"} err="failed to get container status \"c817fa7115dfa275a27b221f4a59c188ad7fa57e98118fd2e67ae7ecdab06b74\": rpc error: code = NotFound desc = could not find container \"c817fa7115dfa275a27b221f4a59c188ad7fa57e98118fd2e67ae7ecdab06b74\": container with ID starting with c817fa7115dfa275a27b221f4a59c188ad7fa57e98118fd2e67ae7ecdab06b74 not found: ID does not exist" Jul 06 14:28:01.668935 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:01.668916 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jrl6w"] Jul 06 14:28:01.675254 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:01.675232 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-jrl6w"] Jul 06 14:28:02.412393 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:02.412366 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5" path="/var/lib/kubelet/pods/1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5/volumes" Jul 06 14:28:10.643068 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:10.643039 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dg5sb" Jul 06 14:28:13.226869 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:13.226826 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:13.327031 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:13.327000 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:15.240184 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:15.240152 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:27.827295 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:27.827265 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:28.059388 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.059352 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j6gx6"] Jul 06 14:28:28.059833 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.059815 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5" containerName="authorino" Jul 06 14:28:28.059906 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.059836 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5" containerName="authorino" Jul 06 14:28:28.059942 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.059929 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ef6f2e3-ef2c-40e2-85ab-ca690801ddd5" containerName="authorino" Jul 06 14:28:28.065621 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.065600 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j6gx6" Jul 06 14:28:28.068799 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.068775 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6h22t\"" Jul 06 14:28:28.070290 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.070267 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j6gx6"] Jul 06 14:28:28.127603 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.127506 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lngm2\" (UniqueName: \"kubernetes.io/projected/6258bc8b-0bde-48f4-af9e-edca7718075f-kube-api-access-lngm2\") pod \"authorino-5d4b67c446-j6gx6\" (UID: \"6258bc8b-0bde-48f4-af9e-edca7718075f\") " pod="kuadrant-system/authorino-5d4b67c446-j6gx6" Jul 06 14:28:28.190175 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.190136 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:28.228623 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.228589 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lngm2\" (UniqueName: \"kubernetes.io/projected/6258bc8b-0bde-48f4-af9e-edca7718075f-kube-api-access-lngm2\") pod \"authorino-5d4b67c446-j6gx6\" (UID: \"6258bc8b-0bde-48f4-af9e-edca7718075f\") " pod="kuadrant-system/authorino-5d4b67c446-j6gx6" Jul 06 14:28:28.241570 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.241510 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lngm2\" (UniqueName: \"kubernetes.io/projected/6258bc8b-0bde-48f4-af9e-edca7718075f-kube-api-access-lngm2\") pod \"authorino-5d4b67c446-j6gx6\" (UID: \"6258bc8b-0bde-48f4-af9e-edca7718075f\") " pod="kuadrant-system/authorino-5d4b67c446-j6gx6" Jul 06 14:28:28.307422 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.307386 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j6gx6"] Jul 06 14:28:28.307659 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.307645 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j6gx6" Jul 06 14:28:28.359339 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.351998 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-fc8649c5-fnh5x"] Jul 06 14:28:28.370222 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.370182 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fc8649c5-fnh5x"] Jul 06 14:28:28.370370 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.370279 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fc8649c5-fnh5x" Jul 06 14:28:28.430771 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.430733 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xx68\" (UniqueName: \"kubernetes.io/projected/9ede9be4-23d3-4c99-ae70-10ca2894b6c9-kube-api-access-4xx68\") pod \"authorino-fc8649c5-fnh5x\" (UID: \"9ede9be4-23d3-4c99-ae70-10ca2894b6c9\") " pod="kuadrant-system/authorino-fc8649c5-fnh5x" Jul 06 14:28:28.458926 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.458901 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j6gx6"] Jul 06 14:28:28.461058 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:28:28.461030 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6258bc8b_0bde_48f4_af9e_edca7718075f.slice/crio-659fb634ff355292a65edaa239bf5cc00fe00171862002b6422d9b297e66ad78 WatchSource:0}: Error finding container 659fb634ff355292a65edaa239bf5cc00fe00171862002b6422d9b297e66ad78: Status 404 returned error can't find the container with id 659fb634ff355292a65edaa239bf5cc00fe00171862002b6422d9b297e66ad78 Jul 06 14:28:28.487517 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.487490 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fc8649c5-fnh5x"] Jul 06 14:28:28.487801 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:28:28.487777 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4xx68], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-fc8649c5-fnh5x" podUID="9ede9be4-23d3-4c99-ae70-10ca2894b6c9" Jul 06 14:28:28.520884 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.520850 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6594465999-qqcgk"] Jul 06 14:28:28.531650 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.531623 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xx68\" (UniqueName: \"kubernetes.io/projected/9ede9be4-23d3-4c99-ae70-10ca2894b6c9-kube-api-access-4xx68\") pod \"authorino-fc8649c5-fnh5x\" (UID: \"9ede9be4-23d3-4c99-ae70-10ca2894b6c9\") " pod="kuadrant-system/authorino-fc8649c5-fnh5x" Jul 06 14:28:28.538229 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.538210 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6594465999-qqcgk"] Jul 06 14:28:28.538335 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.538311 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6594465999-qqcgk" Jul 06 14:28:28.543193 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.543173 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 06 14:28:28.545329 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.545310 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xx68\" (UniqueName: \"kubernetes.io/projected/9ede9be4-23d3-4c99-ae70-10ca2894b6c9-kube-api-access-4xx68\") pod \"authorino-fc8649c5-fnh5x\" (UID: \"9ede9be4-23d3-4c99-ae70-10ca2894b6c9\") " pod="kuadrant-system/authorino-fc8649c5-fnh5x" Jul 06 14:28:28.632892 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.632809 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwr2q\" (UniqueName: \"kubernetes.io/projected/8a80438c-9b8b-46e0-8d42-951921d2eeaf-kube-api-access-gwr2q\") pod \"authorino-6594465999-qqcgk\" (UID: \"8a80438c-9b8b-46e0-8d42-951921d2eeaf\") " pod="kuadrant-system/authorino-6594465999-qqcgk" Jul 06 14:28:28.632892 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.632871 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a80438c-9b8b-46e0-8d42-951921d2eeaf-tls-cert\") pod \"authorino-6594465999-qqcgk\" (UID: \"8a80438c-9b8b-46e0-8d42-951921d2eeaf\") " pod="kuadrant-system/authorino-6594465999-qqcgk" Jul 06 14:28:28.734049 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.734011 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a80438c-9b8b-46e0-8d42-951921d2eeaf-tls-cert\") pod \"authorino-6594465999-qqcgk\" (UID: \"8a80438c-9b8b-46e0-8d42-951921d2eeaf\") " pod="kuadrant-system/authorino-6594465999-qqcgk" Jul 06 14:28:28.734243 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.734108 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwr2q\" (UniqueName: \"kubernetes.io/projected/8a80438c-9b8b-46e0-8d42-951921d2eeaf-kube-api-access-gwr2q\") pod \"authorino-6594465999-qqcgk\" (UID: \"8a80438c-9b8b-46e0-8d42-951921d2eeaf\") " pod="kuadrant-system/authorino-6594465999-qqcgk" Jul 06 14:28:28.736578 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.736539 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a80438c-9b8b-46e0-8d42-951921d2eeaf-tls-cert\") pod \"authorino-6594465999-qqcgk\" (UID: \"8a80438c-9b8b-46e0-8d42-951921d2eeaf\") " pod="kuadrant-system/authorino-6594465999-qqcgk" Jul 06 14:28:28.753419 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.753394 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwr2q\" (UniqueName: \"kubernetes.io/projected/8a80438c-9b8b-46e0-8d42-951921d2eeaf-kube-api-access-gwr2q\") pod \"authorino-6594465999-qqcgk\" (UID: \"8a80438c-9b8b-46e0-8d42-951921d2eeaf\") " pod="kuadrant-system/authorino-6594465999-qqcgk" Jul 06 14:28:28.778622 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.778580 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-j6gx6" event={"ID":"6258bc8b-0bde-48f4-af9e-edca7718075f","Type":"ContainerStarted","Data":"659fb634ff355292a65edaa239bf5cc00fe00171862002b6422d9b297e66ad78"} Jul 06 14:28:28.778763 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.778641 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fc8649c5-fnh5x" Jul 06 14:28:28.809453 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.809428 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fc8649c5-fnh5x" Jul 06 14:28:28.857462 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.857434 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6594465999-qqcgk" Jul 06 14:28:28.936727 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.936701 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xx68\" (UniqueName: \"kubernetes.io/projected/9ede9be4-23d3-4c99-ae70-10ca2894b6c9-kube-api-access-4xx68\") pod \"9ede9be4-23d3-4c99-ae70-10ca2894b6c9\" (UID: \"9ede9be4-23d3-4c99-ae70-10ca2894b6c9\") " Jul 06 14:28:28.938777 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:28.938750 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ede9be4-23d3-4c99-ae70-10ca2894b6c9-kube-api-access-4xx68" (OuterVolumeSpecName: "kube-api-access-4xx68") pod "9ede9be4-23d3-4c99-ae70-10ca2894b6c9" (UID: "9ede9be4-23d3-4c99-ae70-10ca2894b6c9"). InnerVolumeSpecName "kube-api-access-4xx68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:28:29.003576 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:29.003538 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6594465999-qqcgk"] Jul 06 14:28:29.005160 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:28:29.005133 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a80438c_9b8b_46e0_8d42_951921d2eeaf.slice/crio-3cafecba09716bc151f88a7972ff4ba964f41f6f307269dfaff02a652fe46161 WatchSource:0}: Error finding container 3cafecba09716bc151f88a7972ff4ba964f41f6f307269dfaff02a652fe46161: Status 404 returned error can't find the container with id 3cafecba09716bc151f88a7972ff4ba964f41f6f307269dfaff02a652fe46161 Jul 06 14:28:29.038097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:29.038072 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xx68\" (UniqueName: \"kubernetes.io/projected/9ede9be4-23d3-4c99-ae70-10ca2894b6c9-kube-api-access-4xx68\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:28:29.785406 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:29.785368 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-j6gx6" event={"ID":"6258bc8b-0bde-48f4-af9e-edca7718075f","Type":"ContainerStarted","Data":"aebcfca6771ca5db9d96d31d05c8e7a2f8e0d251cb040c7cd705b29d69b6387a"} Jul 06 14:28:29.785406 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:29.785379 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-j6gx6" podUID="6258bc8b-0bde-48f4-af9e-edca7718075f" containerName="authorino" containerID="cri-o://aebcfca6771ca5db9d96d31d05c8e7a2f8e0d251cb040c7cd705b29d69b6387a" gracePeriod=30 Jul 06 14:28:29.786925 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:29.786906 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fc8649c5-fnh5x" Jul 06 14:28:29.787053 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:29.786899 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6594465999-qqcgk" event={"ID":"8a80438c-9b8b-46e0-8d42-951921d2eeaf","Type":"ContainerStarted","Data":"f8daa34567062bce41e0132fd850d006e073747127da72b2f3772a018bc6fa62"} Jul 06 14:28:29.787053 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:29.787025 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6594465999-qqcgk" event={"ID":"8a80438c-9b8b-46e0-8d42-951921d2eeaf","Type":"ContainerStarted","Data":"3cafecba09716bc151f88a7972ff4ba964f41f6f307269dfaff02a652fe46161"} Jul 06 14:28:29.827026 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:29.826976 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-j6gx6" podStartSLOduration=1.277871021 podStartE2EDuration="1.826960897s" totalImagesPullingTime="549.089876ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:28:29.824954267 +0000 UTC m=+529.908247550" watchObservedRunningTime="2026-07-06 14:28:29.826960897 +0000 UTC m=+529.910254169" Jul 06 14:28:29.884215 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:29.884183 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fc8649c5-fnh5x"] Jul 06 14:28:29.888528 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:29.888502 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-fc8649c5-fnh5x"] Jul 06 14:28:29.913004 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:29.912953 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6594465999-qqcgk" podStartSLOduration=1.447866088 podStartE2EDuration="1.912937425s" totalImagesPullingTime="465.071337ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:28:29.91129194 +0000 UTC m=+529.994585214" watchObservedRunningTime="2026-07-06 14:28:29.912937425 +0000 UTC m=+529.996230698" Jul 06 14:28:30.045013 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:30.044943 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j6gx6" Jul 06 14:28:30.146860 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:30.146826 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lngm2\" (UniqueName: \"kubernetes.io/projected/6258bc8b-0bde-48f4-af9e-edca7718075f-kube-api-access-lngm2\") pod \"6258bc8b-0bde-48f4-af9e-edca7718075f\" (UID: \"6258bc8b-0bde-48f4-af9e-edca7718075f\") " Jul 06 14:28:30.148968 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:30.148946 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6258bc8b-0bde-48f4-af9e-edca7718075f-kube-api-access-lngm2" (OuterVolumeSpecName: "kube-api-access-lngm2") pod "6258bc8b-0bde-48f4-af9e-edca7718075f" (UID: "6258bc8b-0bde-48f4-af9e-edca7718075f"). InnerVolumeSpecName "kube-api-access-lngm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:28:30.248235 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:30.248204 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lngm2\" (UniqueName: \"kubernetes.io/projected/6258bc8b-0bde-48f4-af9e-edca7718075f-kube-api-access-lngm2\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:28:30.412630 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:30.412538 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ede9be4-23d3-4c99-ae70-10ca2894b6c9" path="/var/lib/kubelet/pods/9ede9be4-23d3-4c99-ae70-10ca2894b6c9/volumes" Jul 06 14:28:30.793428 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:30.793402 2582 generic.go:356] "Generic (PLEG): container finished" podID="6258bc8b-0bde-48f4-af9e-edca7718075f" containerID="aebcfca6771ca5db9d96d31d05c8e7a2f8e0d251cb040c7cd705b29d69b6387a" exitCode=0 Jul 06 14:28:30.793653 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:30.793445 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j6gx6" Jul 06 14:28:30.793653 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:30.793488 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-j6gx6" event={"ID":"6258bc8b-0bde-48f4-af9e-edca7718075f","Type":"ContainerDied","Data":"aebcfca6771ca5db9d96d31d05c8e7a2f8e0d251cb040c7cd705b29d69b6387a"} Jul 06 14:28:30.793653 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:30.793523 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-j6gx6" event={"ID":"6258bc8b-0bde-48f4-af9e-edca7718075f","Type":"ContainerDied","Data":"659fb634ff355292a65edaa239bf5cc00fe00171862002b6422d9b297e66ad78"} Jul 06 14:28:30.793653 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:30.793542 2582 scope.go:117] "RemoveContainer" containerID="aebcfca6771ca5db9d96d31d05c8e7a2f8e0d251cb040c7cd705b29d69b6387a" Jul 06 14:28:30.802403 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:30.802384 2582 scope.go:117] "RemoveContainer" containerID="aebcfca6771ca5db9d96d31d05c8e7a2f8e0d251cb040c7cd705b29d69b6387a" Jul 06 14:28:30.802721 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:28:30.802701 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aebcfca6771ca5db9d96d31d05c8e7a2f8e0d251cb040c7cd705b29d69b6387a\": container with ID starting with aebcfca6771ca5db9d96d31d05c8e7a2f8e0d251cb040c7cd705b29d69b6387a not found: ID does not exist" containerID="aebcfca6771ca5db9d96d31d05c8e7a2f8e0d251cb040c7cd705b29d69b6387a" Jul 06 14:28:30.802807 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:30.802735 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aebcfca6771ca5db9d96d31d05c8e7a2f8e0d251cb040c7cd705b29d69b6387a"} err="failed to get container status \"aebcfca6771ca5db9d96d31d05c8e7a2f8e0d251cb040c7cd705b29d69b6387a\": rpc error: code = NotFound desc = could not find container \"aebcfca6771ca5db9d96d31d05c8e7a2f8e0d251cb040c7cd705b29d69b6387a\": container with ID starting with aebcfca6771ca5db9d96d31d05c8e7a2f8e0d251cb040c7cd705b29d69b6387a not found: ID does not exist" Jul 06 14:28:30.820258 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:30.820235 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j6gx6"] Jul 06 14:28:30.827651 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:30.827629 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j6gx6"] Jul 06 14:28:32.417591 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:32.417499 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6258bc8b-0bde-48f4-af9e-edca7718075f" path="/var/lib/kubelet/pods/6258bc8b-0bde-48f4-af9e-edca7718075f/volumes" Jul 06 14:28:34.573191 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:34.573164 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:34.685389 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:34.685352 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:34.841103 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:34.841010 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:38.088620 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:38.088583 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:38.197964 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:38.197920 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:59.260971 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:28:59.260930 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:09.143769 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:29:09.143737 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:10.593091 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:29:10.593052 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:11.092797 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:29:11.092752 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:11.259071 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:29:11.259038 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:11.780389 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:29:11.780348 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:11.880183 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:29:11.880143 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:12.066390 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:29:12.066348 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:29:21.751519 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:29:21.751483 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:21.848974 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:29:21.848941 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:26.257979 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:29:26.257935 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:31.384016 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:29:31.383977 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:31.910728 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:29:31.910696 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:29:43.797427 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:29:43.797377 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:44.436211 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:29:44.436177 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:29:47.793382 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:29:47.793352 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:48.924849 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:29:48.924818 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:29:58.521256 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:29:58.521221 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:02.401981 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:02.401877 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:03.911326 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:03.911291 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:30:19.485613 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.485577 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl"] Jul 06 14:30:19.486002 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.485883 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6258bc8b-0bde-48f4-af9e-edca7718075f" containerName="authorino" Jul 06 14:30:19.486002 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.485895 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6258bc8b-0bde-48f4-af9e-edca7718075f" containerName="authorino" Jul 06 14:30:19.486002 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.485965 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6258bc8b-0bde-48f4-af9e-edca7718075f" containerName="authorino" Jul 06 14:30:19.488931 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.488914 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.495259 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.495110 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 06 14:30:19.495259 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.495124 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pgwdp\"" Jul 06 14:30:19.495479 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.495464 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 14:30:19.495537 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.495495 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 14:30:19.512478 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.512453 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl"] Jul 06 14:30:19.515213 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.515186 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:19.598663 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.598625 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fd494d1-9789-4e9f-92d0-77fd7cb5048f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-swlhl\" (UID: \"0fd494d1-9789-4e9f-92d0-77fd7cb5048f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.598663 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.598659 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fd494d1-9789-4e9f-92d0-77fd7cb5048f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-swlhl\" (UID: \"0fd494d1-9789-4e9f-92d0-77fd7cb5048f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.598892 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.598689 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96kdg\" (UniqueName: \"kubernetes.io/projected/0fd494d1-9789-4e9f-92d0-77fd7cb5048f-kube-api-access-96kdg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-swlhl\" (UID: \"0fd494d1-9789-4e9f-92d0-77fd7cb5048f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.598892 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.598775 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd494d1-9789-4e9f-92d0-77fd7cb5048f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-swlhl\" (UID: \"0fd494d1-9789-4e9f-92d0-77fd7cb5048f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.598892 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.598834 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fd494d1-9789-4e9f-92d0-77fd7cb5048f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-swlhl\" (UID: \"0fd494d1-9789-4e9f-92d0-77fd7cb5048f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.598892 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.598878 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fd494d1-9789-4e9f-92d0-77fd7cb5048f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-swlhl\" (UID: \"0fd494d1-9789-4e9f-92d0-77fd7cb5048f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.699829 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.699789 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fd494d1-9789-4e9f-92d0-77fd7cb5048f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-swlhl\" (UID: \"0fd494d1-9789-4e9f-92d0-77fd7cb5048f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.699829 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.699829 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fd494d1-9789-4e9f-92d0-77fd7cb5048f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-swlhl\" (UID: \"0fd494d1-9789-4e9f-92d0-77fd7cb5048f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.700097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.699875 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96kdg\" (UniqueName: \"kubernetes.io/projected/0fd494d1-9789-4e9f-92d0-77fd7cb5048f-kube-api-access-96kdg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-swlhl\" (UID: \"0fd494d1-9789-4e9f-92d0-77fd7cb5048f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.700097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.699905 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd494d1-9789-4e9f-92d0-77fd7cb5048f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-swlhl\" (UID: \"0fd494d1-9789-4e9f-92d0-77fd7cb5048f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.700097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.699953 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fd494d1-9789-4e9f-92d0-77fd7cb5048f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-swlhl\" (UID: \"0fd494d1-9789-4e9f-92d0-77fd7cb5048f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.700097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.700002 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fd494d1-9789-4e9f-92d0-77fd7cb5048f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-swlhl\" (UID: \"0fd494d1-9789-4e9f-92d0-77fd7cb5048f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.700356 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.700336 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fd494d1-9789-4e9f-92d0-77fd7cb5048f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-swlhl\" (UID: \"0fd494d1-9789-4e9f-92d0-77fd7cb5048f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.700421 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.700359 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd494d1-9789-4e9f-92d0-77fd7cb5048f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-swlhl\" (UID: \"0fd494d1-9789-4e9f-92d0-77fd7cb5048f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.700421 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.700405 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fd494d1-9789-4e9f-92d0-77fd7cb5048f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-swlhl\" (UID: \"0fd494d1-9789-4e9f-92d0-77fd7cb5048f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.702263 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.702241 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fd494d1-9789-4e9f-92d0-77fd7cb5048f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-swlhl\" (UID: \"0fd494d1-9789-4e9f-92d0-77fd7cb5048f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.702402 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.702388 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fd494d1-9789-4e9f-92d0-77fd7cb5048f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-swlhl\" (UID: \"0fd494d1-9789-4e9f-92d0-77fd7cb5048f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.709606 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.709586 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96kdg\" (UniqueName: \"kubernetes.io/projected/0fd494d1-9789-4e9f-92d0-77fd7cb5048f-kube-api-access-96kdg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-swlhl\" (UID: \"0fd494d1-9789-4e9f-92d0-77fd7cb5048f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.798717 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.798678 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:19.939758 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.939735 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl"] Jul 06 14:30:19.940978 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:30:19.940958 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd494d1_9789_4e9f_92d0_77fd7cb5048f.slice/crio-8ad4ae85b0907d3127aeb26f033f2d08c16564ae6c1f2e96d75870c0ee9740c9 WatchSource:0}: Error finding container 8ad4ae85b0907d3127aeb26f033f2d08c16564ae6c1f2e96d75870c0ee9740c9: Status 404 returned error can't find the container with id 8ad4ae85b0907d3127aeb26f033f2d08c16564ae6c1f2e96d75870c0ee9740c9 Jul 06 14:30:19.942367 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:19.942347 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 14:30:20.349723 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:20.349676 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" event={"ID":"0fd494d1-9789-4e9f-92d0-77fd7cb5048f","Type":"ContainerStarted","Data":"8ad4ae85b0907d3127aeb26f033f2d08c16564ae6c1f2e96d75870c0ee9740c9"} Jul 06 14:30:21.357837 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:21.357805 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" event={"ID":"0fd494d1-9789-4e9f-92d0-77fd7cb5048f","Type":"ContainerStarted","Data":"e2a035415f62676aae2b28c5d14a0d51da16374a26914799d043cd9a3a1c1aa0"} Jul 06 14:30:21.379087 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:21.379028 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" podStartSLOduration=1.141354199 podStartE2EDuration="2.379012141s" totalImagesPullingTime="1.237657942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:21.378231125 +0000 UTC m=+641.461524397" watchObservedRunningTime="2026-07-06 14:30:21.379012141 +0000 UTC m=+641.462305413" Jul 06 14:30:21.521972 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:21.521881 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:30:29.799513 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:29.799479 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:29.799939 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:29.799574 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:29.812017 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:29.811986 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:30.417543 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:30.417509 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-swlhl" Jul 06 14:30:49.781356 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.781315 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx"] Jul 06 14:30:49.787579 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.787537 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:49.793823 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.793669 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 06 14:30:49.810429 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.810401 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx"] Jul 06 14:30:49.853267 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.853235 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e280060-2c0b-4f31-9370-ca293786dc75-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx\" (UID: \"8e280060-2c0b-4f31-9370-ca293786dc75\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:49.853472 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.853290 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e280060-2c0b-4f31-9370-ca293786dc75-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx\" (UID: \"8e280060-2c0b-4f31-9370-ca293786dc75\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:49.853472 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.853317 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e280060-2c0b-4f31-9370-ca293786dc75-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx\" (UID: \"8e280060-2c0b-4f31-9370-ca293786dc75\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:49.853472 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.853363 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e280060-2c0b-4f31-9370-ca293786dc75-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx\" (UID: \"8e280060-2c0b-4f31-9370-ca293786dc75\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:49.853472 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.853380 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9mgv\" (UniqueName: \"kubernetes.io/projected/8e280060-2c0b-4f31-9370-ca293786dc75-kube-api-access-m9mgv\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx\" (UID: \"8e280060-2c0b-4f31-9370-ca293786dc75\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:49.853472 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.853455 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e280060-2c0b-4f31-9370-ca293786dc75-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx\" (UID: \"8e280060-2c0b-4f31-9370-ca293786dc75\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:49.882830 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.882798 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:49.954298 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.954260 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e280060-2c0b-4f31-9370-ca293786dc75-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx\" (UID: \"8e280060-2c0b-4f31-9370-ca293786dc75\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:49.954298 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.954296 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e280060-2c0b-4f31-9370-ca293786dc75-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx\" (UID: \"8e280060-2c0b-4f31-9370-ca293786dc75\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:49.954591 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.954430 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e280060-2c0b-4f31-9370-ca293786dc75-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx\" (UID: \"8e280060-2c0b-4f31-9370-ca293786dc75\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:49.954591 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.954464 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9mgv\" (UniqueName: \"kubernetes.io/projected/8e280060-2c0b-4f31-9370-ca293786dc75-kube-api-access-m9mgv\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx\" (UID: \"8e280060-2c0b-4f31-9370-ca293786dc75\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:49.954591 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.954512 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e280060-2c0b-4f31-9370-ca293786dc75-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx\" (UID: \"8e280060-2c0b-4f31-9370-ca293786dc75\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:49.954591 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.954577 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e280060-2c0b-4f31-9370-ca293786dc75-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx\" (UID: \"8e280060-2c0b-4f31-9370-ca293786dc75\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:49.954838 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.954719 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e280060-2c0b-4f31-9370-ca293786dc75-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx\" (UID: \"8e280060-2c0b-4f31-9370-ca293786dc75\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:49.954838 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.954800 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e280060-2c0b-4f31-9370-ca293786dc75-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx\" (UID: \"8e280060-2c0b-4f31-9370-ca293786dc75\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:49.954929 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.954911 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e280060-2c0b-4f31-9370-ca293786dc75-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx\" (UID: \"8e280060-2c0b-4f31-9370-ca293786dc75\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:49.956781 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.956759 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e280060-2c0b-4f31-9370-ca293786dc75-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx\" (UID: \"8e280060-2c0b-4f31-9370-ca293786dc75\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:49.957000 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.956983 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e280060-2c0b-4f31-9370-ca293786dc75-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx\" (UID: \"8e280060-2c0b-4f31-9370-ca293786dc75\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:49.966251 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:49.966228 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9mgv\" (UniqueName: \"kubernetes.io/projected/8e280060-2c0b-4f31-9370-ca293786dc75-kube-api-access-m9mgv\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx\" (UID: \"8e280060-2c0b-4f31-9370-ca293786dc75\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:50.096296 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:50.096201 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:30:50.232433 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:50.232401 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx"] Jul 06 14:30:50.234168 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:30:50.234138 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e280060_2c0b_4f31_9370_ca293786dc75.slice/crio-2b9ad71f59c8f68b35af9cfad56b1c350a618006716738312d32ade9f259e326 WatchSource:0}: Error finding container 2b9ad71f59c8f68b35af9cfad56b1c350a618006716738312d32ade9f259e326: Status 404 returned error can't find the container with id 2b9ad71f59c8f68b35af9cfad56b1c350a618006716738312d32ade9f259e326 Jul 06 14:30:50.499814 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:50.499777 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" event={"ID":"8e280060-2c0b-4f31-9370-ca293786dc75","Type":"ContainerStarted","Data":"2b9ad71f59c8f68b35af9cfad56b1c350a618006716738312d32ade9f259e326"} Jul 06 14:30:51.505937 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:51.505902 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" event={"ID":"8e280060-2c0b-4f31-9370-ca293786dc75","Type":"ContainerStarted","Data":"770e702178491d3c28521d6df0d0d8af370cbdfcb3e575fc06dbbfdcb52f27bd"} Jul 06 14:30:51.533297 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:51.533245 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" podStartSLOduration=2.27936442 podStartE2EDuration="2.533229665s" totalImagesPullingTime="253.865245ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:51.53242313 +0000 UTC m=+671.615716402" watchObservedRunningTime="2026-07-06 14:30:51.533229665 +0000 UTC m=+671.616522938" Jul 06 14:30:52.323320 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:30:52.323291 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:31:00.096518 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:00.096466 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:31:00.096518 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:00.096532 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:31:00.108609 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:00.108578 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:31:00.564672 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:00.564647 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx" Jul 06 14:31:41.550776 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:41.550680 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:41.620909 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:41.620877 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:45.711597 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:45.711534 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:45.813921 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:45.813866 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:46.930161 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:46.930129 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:47.048796 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.048758 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:47.139799 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.139761 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6594465999-qqcgk"] Jul 06 14:31:47.140018 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.139991 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6594465999-qqcgk" podUID="8a80438c-9b8b-46e0-8d42-951921d2eeaf" containerName="authorino" containerID="cri-o://f8daa34567062bce41e0132fd850d006e073747127da72b2f3772a018bc6fa62" gracePeriod=30 Jul 06 14:31:47.395915 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.395892 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6594465999-qqcgk" Jul 06 14:31:47.459069 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.459035 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwr2q\" (UniqueName: \"kubernetes.io/projected/8a80438c-9b8b-46e0-8d42-951921d2eeaf-kube-api-access-gwr2q\") pod \"8a80438c-9b8b-46e0-8d42-951921d2eeaf\" (UID: \"8a80438c-9b8b-46e0-8d42-951921d2eeaf\") " Jul 06 14:31:47.459254 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.459076 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a80438c-9b8b-46e0-8d42-951921d2eeaf-tls-cert\") pod \"8a80438c-9b8b-46e0-8d42-951921d2eeaf\" (UID: \"8a80438c-9b8b-46e0-8d42-951921d2eeaf\") " Jul 06 14:31:47.461306 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.461275 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a80438c-9b8b-46e0-8d42-951921d2eeaf-kube-api-access-gwr2q" (OuterVolumeSpecName: "kube-api-access-gwr2q") pod "8a80438c-9b8b-46e0-8d42-951921d2eeaf" (UID: "8a80438c-9b8b-46e0-8d42-951921d2eeaf"). InnerVolumeSpecName "kube-api-access-gwr2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:31:47.469323 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.469301 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a80438c-9b8b-46e0-8d42-951921d2eeaf-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "8a80438c-9b8b-46e0-8d42-951921d2eeaf" (UID: "8a80438c-9b8b-46e0-8d42-951921d2eeaf"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:31:47.560472 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.560438 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwr2q\" (UniqueName: \"kubernetes.io/projected/8a80438c-9b8b-46e0-8d42-951921d2eeaf-kube-api-access-gwr2q\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:31:47.560472 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.560464 2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a80438c-9b8b-46e0-8d42-951921d2eeaf-tls-cert\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:31:47.792920 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.792884 2582 generic.go:356] "Generic (PLEG): container finished" podID="8a80438c-9b8b-46e0-8d42-951921d2eeaf" containerID="f8daa34567062bce41e0132fd850d006e073747127da72b2f3772a018bc6fa62" exitCode=0 Jul 06 14:31:47.793113 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.792933 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6594465999-qqcgk" Jul 06 14:31:47.793113 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.792972 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6594465999-qqcgk" event={"ID":"8a80438c-9b8b-46e0-8d42-951921d2eeaf","Type":"ContainerDied","Data":"f8daa34567062bce41e0132fd850d006e073747127da72b2f3772a018bc6fa62"} Jul 06 14:31:47.793113 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.793028 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6594465999-qqcgk" event={"ID":"8a80438c-9b8b-46e0-8d42-951921d2eeaf","Type":"ContainerDied","Data":"3cafecba09716bc151f88a7972ff4ba964f41f6f307269dfaff02a652fe46161"} Jul 06 14:31:47.793113 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.793051 2582 scope.go:117] "RemoveContainer" containerID="f8daa34567062bce41e0132fd850d006e073747127da72b2f3772a018bc6fa62" Jul 06 14:31:47.802053 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.802038 2582 scope.go:117] "RemoveContainer" containerID="f8daa34567062bce41e0132fd850d006e073747127da72b2f3772a018bc6fa62" Jul 06 14:31:47.802291 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:31:47.802275 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8daa34567062bce41e0132fd850d006e073747127da72b2f3772a018bc6fa62\": container with ID starting with f8daa34567062bce41e0132fd850d006e073747127da72b2f3772a018bc6fa62 not found: ID does not exist" containerID="f8daa34567062bce41e0132fd850d006e073747127da72b2f3772a018bc6fa62" Jul 06 14:31:47.802337 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.802299 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8daa34567062bce41e0132fd850d006e073747127da72b2f3772a018bc6fa62"} err="failed to get container status \"f8daa34567062bce41e0132fd850d006e073747127da72b2f3772a018bc6fa62\": rpc error: code = NotFound desc = could not find container \"f8daa34567062bce41e0132fd850d006e073747127da72b2f3772a018bc6fa62\": container with ID starting with f8daa34567062bce41e0132fd850d006e073747127da72b2f3772a018bc6fa62 not found: ID does not exist" Jul 06 14:31:47.815980 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.815926 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6594465999-qqcgk"] Jul 06 14:31:47.819928 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:47.819908 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6594465999-qqcgk"] Jul 06 14:31:48.412388 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:31:48.412357 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a80438c-9b8b-46e0-8d42-951921d2eeaf" path="/var/lib/kubelet/pods/8a80438c-9b8b-46e0-8d42-951921d2eeaf/volumes" Jul 06 14:32:01.864284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:32:01.864252 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:17.922923 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:32:17.922888 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:32:29.121702 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:32:29.121665 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:32:39.316765 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:32:39.316729 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:32:47.918484 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:32:47.918445 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:32:59.212338 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:32:59.212302 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:33:01.724235 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:33:01.724194 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:03.556346 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:33:03.556290 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:25.007473 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:33:25.007439 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:33:33.619365 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:33:33.619309 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:33:38.477075 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:33:38.477027 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:38.577737 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:33:38.577700 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:38.725603 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:33:38.725534 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:45.367734 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:33:45.367691 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:45.492743 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:33:45.492706 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:45.597161 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:33:45.597113 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:45.927164 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:33:45.927131 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:52.597935 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:33:52.597896 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:52.667245 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:33:52.667205 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:09.615967 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:34:09.615930 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:34:19.406670 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:34:19.406631 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:34:29.021399 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:34:29.021363 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:34:30.865741 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:34:30.865699 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:30.935100 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:34:30.935066 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:36.816666 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:34:36.816627 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:34:47.516710 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:34:47.516673 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:34:49.250121 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:34:49.250084 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:56.323033 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:34:56.322995 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:35:01.751298 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:35:01.751248 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:08.431968 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:35:08.431931 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:35:17.821800 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:35:17.821769 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:35:40.430235 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:35:40.430202 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:35:52.821987 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:35:52.821943 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:36:15.830117 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:36:15.830068 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:36:26.716361 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:36:26.716322 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:36:45.933291 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:36:45.933247 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:36:55.732086 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:36:55.732043 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:37:05.052386 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:05.052346 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:37:14.039208 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:14.039169 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:37:23.436812 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:23.436772 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:37:52.625421 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:52.625333 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j"] Jul 06 14:37:52.625954 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:52.625582 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j" podUID="068ec0ba-6c81-416a-ba87-976180cd1517" containerName="manager" containerID="cri-o://dc7cbc0fdd17ff65d617ec174549126d3f3a7651505889517ee93db94c5a9ddf" gracePeriod=10 Jul 06 14:37:55.080448 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:55.080421 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j" Jul 06 14:37:55.161909 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:55.161828 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/068ec0ba-6c81-416a-ba87-976180cd1517-extensions-socket-volume\") pod \"068ec0ba-6c81-416a-ba87-976180cd1517\" (UID: \"068ec0ba-6c81-416a-ba87-976180cd1517\") " Jul 06 14:37:55.162048 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:55.161908 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gjwk\" (UniqueName: \"kubernetes.io/projected/068ec0ba-6c81-416a-ba87-976180cd1517-kube-api-access-5gjwk\") pod \"068ec0ba-6c81-416a-ba87-976180cd1517\" (UID: \"068ec0ba-6c81-416a-ba87-976180cd1517\") " Jul 06 14:37:55.162259 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:55.162233 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/068ec0ba-6c81-416a-ba87-976180cd1517-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "068ec0ba-6c81-416a-ba87-976180cd1517" (UID: "068ec0ba-6c81-416a-ba87-976180cd1517"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:37:55.164093 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:55.164062 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/068ec0ba-6c81-416a-ba87-976180cd1517-kube-api-access-5gjwk" (OuterVolumeSpecName: "kube-api-access-5gjwk") pod "068ec0ba-6c81-416a-ba87-976180cd1517" (UID: "068ec0ba-6c81-416a-ba87-976180cd1517"). InnerVolumeSpecName "kube-api-access-5gjwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:37:55.262818 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:55.262764 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gjwk\" (UniqueName: \"kubernetes.io/projected/068ec0ba-6c81-416a-ba87-976180cd1517-kube-api-access-5gjwk\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:37:55.262818 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:55.262812 2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/068ec0ba-6c81-416a-ba87-976180cd1517-extensions-socket-volume\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:37:55.683415 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:55.683377 2582 generic.go:356] "Generic (PLEG): container finished" podID="068ec0ba-6c81-416a-ba87-976180cd1517" containerID="dc7cbc0fdd17ff65d617ec174549126d3f3a7651505889517ee93db94c5a9ddf" exitCode=0 Jul 06 14:37:55.683626 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:55.683425 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j" event={"ID":"068ec0ba-6c81-416a-ba87-976180cd1517","Type":"ContainerDied","Data":"dc7cbc0fdd17ff65d617ec174549126d3f3a7651505889517ee93db94c5a9ddf"} Jul 06 14:37:55.683626 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:55.683472 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j" event={"ID":"068ec0ba-6c81-416a-ba87-976180cd1517","Type":"ContainerDied","Data":"faadc8c351d069a41aacad7138775f1b465cab9c67e4cd2b1007c0e7a024518c"} Jul 06 14:37:55.683626 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:55.683426 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j" Jul 06 14:37:55.683626 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:55.683495 2582 scope.go:117] "RemoveContainer" containerID="dc7cbc0fdd17ff65d617ec174549126d3f3a7651505889517ee93db94c5a9ddf" Jul 06 14:37:55.694005 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:55.693979 2582 scope.go:117] "RemoveContainer" containerID="dc7cbc0fdd17ff65d617ec174549126d3f3a7651505889517ee93db94c5a9ddf" Jul 06 14:37:55.694304 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:37:55.694282 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc7cbc0fdd17ff65d617ec174549126d3f3a7651505889517ee93db94c5a9ddf\": container with ID starting with dc7cbc0fdd17ff65d617ec174549126d3f3a7651505889517ee93db94c5a9ddf not found: ID does not exist" containerID="dc7cbc0fdd17ff65d617ec174549126d3f3a7651505889517ee93db94c5a9ddf" Jul 06 14:37:55.694376 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:55.694318 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc7cbc0fdd17ff65d617ec174549126d3f3a7651505889517ee93db94c5a9ddf"} err="failed to get container status \"dc7cbc0fdd17ff65d617ec174549126d3f3a7651505889517ee93db94c5a9ddf\": rpc error: code = NotFound desc = could not find container \"dc7cbc0fdd17ff65d617ec174549126d3f3a7651505889517ee93db94c5a9ddf\": container with ID starting with dc7cbc0fdd17ff65d617ec174549126d3f3a7651505889517ee93db94c5a9ddf not found: ID does not exist" Jul 06 14:37:55.711383 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:55.711348 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j"] Jul 06 14:37:55.718854 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:55.718820 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jdj5j"] Jul 06 14:37:56.412812 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:37:56.412780 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="068ec0ba-6c81-416a-ba87-976180cd1517" path="/var/lib/kubelet/pods/068ec0ba-6c81-416a-ba87-976180cd1517/volumes" Jul 06 14:38:53.810899 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:53.810862 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m77cl"] Jul 06 14:38:53.811344 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:53.811192 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a80438c-9b8b-46e0-8d42-951921d2eeaf" containerName="authorino" Jul 06 14:38:53.811344 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:53.811204 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a80438c-9b8b-46e0-8d42-951921d2eeaf" containerName="authorino" Jul 06 14:38:53.811344 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:53.811219 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="068ec0ba-6c81-416a-ba87-976180cd1517" containerName="manager" Jul 06 14:38:53.811344 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:53.811226 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="068ec0ba-6c81-416a-ba87-976180cd1517" containerName="manager" Jul 06 14:38:53.811344 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:53.811288 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="068ec0ba-6c81-416a-ba87-976180cd1517" containerName="manager" Jul 06 14:38:53.811344 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:53.811295 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a80438c-9b8b-46e0-8d42-951921d2eeaf" containerName="authorino" Jul 06 14:38:53.815596 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:53.815580 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m77cl" Jul 06 14:38:53.819221 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:53.819204 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-psqvr\"" Jul 06 14:38:53.834011 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:53.833986 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m77cl"] Jul 06 14:38:53.845079 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:53.845056 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwqts\" (UniqueName: \"kubernetes.io/projected/a2dfcf31-6063-499e-a84f-da4bcf0e6a57-kube-api-access-lwqts\") pod \"kuadrant-operator-controller-manager-86878c769f-m77cl\" (UID: \"a2dfcf31-6063-499e-a84f-da4bcf0e6a57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m77cl" Jul 06 14:38:53.845257 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:53.845138 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2dfcf31-6063-499e-a84f-da4bcf0e6a57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m77cl\" (UID: \"a2dfcf31-6063-499e-a84f-da4bcf0e6a57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m77cl" Jul 06 14:38:53.945725 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:53.945684 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2dfcf31-6063-499e-a84f-da4bcf0e6a57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m77cl\" (UID: \"a2dfcf31-6063-499e-a84f-da4bcf0e6a57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m77cl" Jul 06 14:38:53.945725 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:53.945729 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwqts\" (UniqueName: \"kubernetes.io/projected/a2dfcf31-6063-499e-a84f-da4bcf0e6a57-kube-api-access-lwqts\") pod \"kuadrant-operator-controller-manager-86878c769f-m77cl\" (UID: \"a2dfcf31-6063-499e-a84f-da4bcf0e6a57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m77cl" Jul 06 14:38:53.946085 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:53.946067 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2dfcf31-6063-499e-a84f-da4bcf0e6a57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m77cl\" (UID: \"a2dfcf31-6063-499e-a84f-da4bcf0e6a57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m77cl" Jul 06 14:38:53.955034 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:53.955001 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwqts\" (UniqueName: \"kubernetes.io/projected/a2dfcf31-6063-499e-a84f-da4bcf0e6a57-kube-api-access-lwqts\") pod \"kuadrant-operator-controller-manager-86878c769f-m77cl\" (UID: \"a2dfcf31-6063-499e-a84f-da4bcf0e6a57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m77cl" Jul 06 14:38:54.125918 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:54.125807 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m77cl" Jul 06 14:38:54.279838 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:38:54.279810 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2dfcf31_6063_499e_a84f_da4bcf0e6a57.slice/crio-9de8e2589199f46d945e90eb4dbb64d9b840fe324996759256b2bbef8fb793b0 WatchSource:0}: Error finding container 9de8e2589199f46d945e90eb4dbb64d9b840fe324996759256b2bbef8fb793b0: Status 404 returned error can't find the container with id 9de8e2589199f46d945e90eb4dbb64d9b840fe324996759256b2bbef8fb793b0 Jul 06 14:38:54.281778 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:54.281754 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m77cl"] Jul 06 14:38:54.980189 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:54.980151 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m77cl" event={"ID":"a2dfcf31-6063-499e-a84f-da4bcf0e6a57","Type":"ContainerStarted","Data":"fb8f9521d39a26c70eb6c769fa4a22ec9fd6299cbfa925ac33d94ecfef0e0949"} Jul 06 14:38:54.980611 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:54.980209 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m77cl" event={"ID":"a2dfcf31-6063-499e-a84f-da4bcf0e6a57","Type":"ContainerStarted","Data":"9de8e2589199f46d945e90eb4dbb64d9b840fe324996759256b2bbef8fb793b0"} Jul 06 14:38:54.980611 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:54.980238 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m77cl" Jul 06 14:38:55.017037 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:38:55.016961 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m77cl" podStartSLOduration=2.01694477 podStartE2EDuration="2.01694477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:38:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:38:55.013626107 +0000 UTC m=+1155.096919379" watchObservedRunningTime="2026-07-06 14:38:55.01694477 +0000 UTC m=+1155.100238042" Jul 06 14:39:05.988102 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:39:05.988071 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m77cl" Jul 06 14:39:13.838996 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:39:13.838961 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:39:23.131432 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:39:23.131397 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:39:35.926933 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:39:35.926880 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:39:46.725445 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:39:46.725409 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:39:57.514057 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:39:57.514019 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:40:06.853708 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:40:06.853673 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:40:15.011474 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:40:15.011436 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:40:18.218032 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:40:18.217995 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:40:24.066714 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:40:24.066675 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:40:32.718266 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:40:32.718192 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:40:42.116464 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:40:42.116424 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:40:42.193651 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:40:42.193609 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:40:43.027148 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:40:43.027105 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:40:55.008492 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:40:55.008457 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:41:04.125656 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:41:04.125616 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:41:12.781500 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:41:12.781463 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:41:25.609197 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:41:25.609157 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:41:32.916611 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:41:32.916577 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:41:41.822772 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:41:41.822733 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:41:53.032585 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:41:53.032528 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:42:08.357582 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:42:08.356745 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:42:17.155708 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:42:17.155669 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:42:27.514988 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:42:27.514953 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:42:34.525760 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:42:34.525724 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:42:44.625965 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:42:44.625927 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:42:54.831934 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:42:54.831902 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:43:07.825005 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:43:07.824974 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:43:16.523167 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:43:16.523124 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:43:17.934794 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:43:17.934760 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:43:27.324736 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:43:27.324700 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:43:38.527288 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:43:38.527204 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:43:50.527416 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:43:50.527371 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:43:58.922540 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:43:58.922501 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:44:10.113718 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:44:10.113680 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:44:22.622075 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:44:22.622041 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:44:35.026201 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:44:35.026162 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:44:38.314730 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:44:38.314698 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:44:43.365727 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:44:43.365684 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:45:19.011026 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:19.010963 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:20.931973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:20.931939 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:45:26.228028 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:26.227976 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:31.044170 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:31.044135 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:45:31.435606 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:31.435507 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:34.401796 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:34.401762 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:34.508260 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:34.508233 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:34.897130 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:34.897085 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:40.323608 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:40.323571 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:45:41.230679 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:41.230640 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:41.329870 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:41.329836 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:41.510612 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:41.510517 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:41.698203 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:41.698170 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:42.739667 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:42.739629 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:42.838062 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:42.838031 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:43.029393 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:43.029308 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:43.135998 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:43.135965 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:43.741201 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:43.741169 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:43.873848 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:43.873813 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:45.434013 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:45.433984 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:47.776866 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:47.776832 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:47.999258 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:47.999224 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:48.112829 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:48.112778 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:48.305910 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:48.305877 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:49.411600 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:49.411543 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:54.993593 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:54.993509 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:55.107010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:55.106960 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:55.265837 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:55.265711 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:55.381849 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:55.381794 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:56.420034 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:56.420003 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:56.529707 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:56.529665 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:56.623326 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:56.623278 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:56.929063 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:56.929012 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:57.081884 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:57.081851 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:57.194768 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:57.194686 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:58.189984 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:45:58.189951 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:01.522149 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:01.522095 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:01.936564 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:01.936507 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:08.296515 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:08.296480 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:08.396716 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:08.396684 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:14.927612 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:14.927571 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:15.023106 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:15.023060 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:15.200039 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:15.199940 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:15.295645 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:15.295589 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:16.412598 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:16.412531 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:16.547211 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:16.547164 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:16.651906 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:16.651853 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:16.767466 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:16.767375 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:17.380496 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:17.380463 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:17.483425 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:17.483374 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:19.049402 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:19.049365 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:20.820591 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:20.820525 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:21.017325 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:21.017295 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:21.119451 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:21.119361 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:21.464750 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:21.464641 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:24.534945 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:24.534911 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:28.096055 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:28.096019 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:28.173292 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:28.173259 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:28.617143 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:28.617102 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:28.716993 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:28.716947 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:30.370882 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:30.370849 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:38.368993 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:38.368911 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:38.494156 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:38.494125 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:38.653902 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:38.653805 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:38.803176 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:38.803141 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:46:39.242272 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:46:39.242238 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:04.086185 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:04.086154 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:05.635768 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:05.635734 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:11.937265 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:11.937225 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:12.001484 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:12.001446 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:12.131034 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:12.131003 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:12.325909 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:12.325878 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:28.154839 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:28.154802 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:35.039208 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:35.039171 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:35.143864 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:35.143831 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:35.253284 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:35.253250 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:45.755565 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:45.755514 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:46.582460 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:46.582427 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:53.242648 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:53.242609 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:53.315241 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:53.315201 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:53.414527 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:53.414485 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:53.528211 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:53.528125 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:53.617275 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:53.617234 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:54.380394 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:54.380353 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:54.559452 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:54.559416 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:47:55.438929 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:55.438896 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:47:56.232720 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:47:56.232686 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:02.824181 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:02.824099 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:02.830997 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:02.830966 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:48:02.922901 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:02.922869 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:03.544475 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:03.544432 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:09.930403 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:09.930369 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:09.995250 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:09.995215 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:10.183957 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:10.183861 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:10.319796 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:10.319760 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:48:10.540450 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:10.540412 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:10.901073 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:10.900983 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:13.357653 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:13.357518 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:13.438477 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:13.438443 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:13.605366 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:13.605332 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:14.242970 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:14.242939 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:14.336536 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:14.336504 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:17.822649 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:17.822615 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:18.546210 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:18.546160 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:18.703911 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:18.703875 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:18.966723 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:18.966627 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:19.509475 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:19.509435 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:48:25.278828 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:25.278789 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:25.381859 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:25.381819 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:25.637431 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:25.637397 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:25.734179 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:25.734144 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:26.181721 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:26.181689 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:26.518000 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:26.517917 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:26.715747 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:26.715697 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:26.948950 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:26.948920 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:27.174297 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:27.174260 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:30.133757 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:30.133724 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:48:33.305586 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:33.305527 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:33.390559 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:33.390524 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:33.595138 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:33.595052 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:33.831659 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:33.831625 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:33.943852 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:33.943767 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:34.042335 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:34.042302 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:34.143597 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:34.143535 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:40.637070 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:40.637034 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:40.740301 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:40.740266 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:40.834232 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:40.834199 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:40.985171 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:40.985093 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:48.097519 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:48.097479 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:48.180216 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:48.180168 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:54.666060 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:54.666024 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:55.027688 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:55.027591 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:58.530167 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:48:58.530139 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:01.803021 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:01.802984 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:01.918149 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:01.918111 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:02.014488 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:02.014459 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:02.188215 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:02.188134 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:02.557917 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:02.557875 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:02.656289 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:02.656239 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:04.935399 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:04.935367 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:49:06.239720 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:06.239684 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:17.358230 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.358188 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d"] Jul 06 14:49:17.361658 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.361635 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.364569 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.364519 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ad48ac23\"/\"openshift-service-ca.crt\"" Jul 06 14:49:17.364686 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.364523 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ad48ac23\"/\"kube-root-ca.crt\"" Jul 06 14:49:17.365714 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.365688 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ad48ac23\"/\"default-dockercfg-mvqch\"" Jul 06 14:49:17.365826 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.365759 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ad48ac23\"/\"e2e-lifecycle-model-ad48ac23-kserve-self-signed-certs\"" Jul 06 14:49:17.375617 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.375593 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d"] Jul 06 14:49:17.391369 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.391341 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:17.409748 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.409720 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-dshm\") pod \"e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.409857 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.409755 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-tmp-dir\") pod \"e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.409857 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.409799 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-home\") pod \"e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.409857 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.409835 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-tls-certs\") pod \"e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.409857 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.409852 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdvzc\" (UniqueName: \"kubernetes.io/projected/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-kube-api-access-fdvzc\") pod \"e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.409992 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.409937 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-model-cache\") pod \"e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.511184 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.511147 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-dshm\") pod \"e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.511184 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.511182 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-tmp-dir\") pod \"e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.511395 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.511213 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-home\") pod \"e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.511395 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.511228 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-tls-certs\") pod \"e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.511395 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.511244 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdvzc\" (UniqueName: \"kubernetes.io/projected/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-kube-api-access-fdvzc\") pod \"e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.511395 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.511307 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-model-cache\") pod \"e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.511675 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.511653 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-tmp-dir\") pod \"e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.511747 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.511693 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-home\") pod \"e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.511747 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.511731 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-model-cache\") pod \"e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.513731 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.513709 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-dshm\") pod \"e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.513944 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.513926 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-tls-certs\") pod \"e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.523509 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.523480 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdvzc\" (UniqueName: \"kubernetes.io/projected/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-kube-api-access-fdvzc\") pod \"e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.672790 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.672697 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:17.809861 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:17.809836 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d"] Jul 06 14:49:17.811732 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:49:17.811699 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadf98d06_7cb7_4d0d_99aa_e83e2851c0cd.slice/crio-10956affe9acaa1631ac656b9dfcd29d73d1833978281ab5ef80daf48ce257f4 WatchSource:0}: Error finding container 10956affe9acaa1631ac656b9dfcd29d73d1833978281ab5ef80daf48ce257f4: Status 404 returned error can't find the container with id 10956affe9acaa1631ac656b9dfcd29d73d1833978281ab5ef80daf48ce257f4 Jul 06 14:49:18.086239 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:18.086204 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" event={"ID":"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd","Type":"ContainerStarted","Data":"9e55d5eee330a6c16f03289245614e8c3d8df9364eac9d2f83901a1188c3ab34"} Jul 06 14:49:18.086239 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:18.086245 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" event={"ID":"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd","Type":"ContainerStarted","Data":"10956affe9acaa1631ac656b9dfcd29d73d1833978281ab5ef80daf48ce257f4"} Jul 06 14:49:18.109367 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:18.109309 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" podStartSLOduration=1.109293821 podStartE2EDuration="1.109293821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:49:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:49:18.107305901 +0000 UTC m=+1778.190599175" watchObservedRunningTime="2026-07-06 14:49:18.109293821 +0000 UTC m=+1778.192587093" Jul 06 14:49:20.431004 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:20.430972 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:49:27.673589 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:27.673527 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:27.674015 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:27.673620 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:27.686466 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:27.686431 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:28.149536 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:28.149508 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:49:43.459441 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:43.459404 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:49:47.927423 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:47.927389 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:49.244607 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:49.244565 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:50.272301 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:50.272264 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:52.854224 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:52.854188 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:49:55.452250 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:49:55.452198 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:00.396259 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:00.396224 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d"] Jul 06 14:50:00.695243 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:00.695099 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:04.757600 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:04.757570 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:50:06.087372 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:06.087336 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:15.417110 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.417044 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" podUID="adf98d06-7cb7-4d0d-99aa-e83e2851c0cd" containerName="main" containerID="cri-o://9e55d5eee330a6c16f03289245614e8c3d8df9364eac9d2f83901a1188c3ab34" gracePeriod=45 Jul 06 14:50:15.668336 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.668275 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:50:15.732777 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.732744 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-model-cache\") pod \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " Jul 06 14:50:15.732971 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.732785 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-dshm\") pod \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " Jul 06 14:50:15.732971 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.732851 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-tls-certs\") pod \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " Jul 06 14:50:15.732971 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.732910 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-home\") pod \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " Jul 06 14:50:15.732971 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.732947 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-tmp-dir\") pod \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " Jul 06 14:50:15.733186 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.732990 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdvzc\" (UniqueName: \"kubernetes.io/projected/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-kube-api-access-fdvzc\") pod \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\" (UID: \"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd\") " Jul 06 14:50:15.733186 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.733033 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-model-cache" (OuterVolumeSpecName: "model-cache") pod "adf98d06-7cb7-4d0d-99aa-e83e2851c0cd" (UID: "adf98d06-7cb7-4d0d-99aa-e83e2851c0cd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:50:15.733363 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.733192 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-home" (OuterVolumeSpecName: "home") pod "adf98d06-7cb7-4d0d-99aa-e83e2851c0cd" (UID: "adf98d06-7cb7-4d0d-99aa-e83e2851c0cd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:50:15.733363 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.733285 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "adf98d06-7cb7-4d0d-99aa-e83e2851c0cd" (UID: "adf98d06-7cb7-4d0d-99aa-e83e2851c0cd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:50:15.733363 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.733346 2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-home\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:50:15.733528 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.733364 2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-model-cache\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:50:15.735276 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.735249 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-dshm" (OuterVolumeSpecName: "dshm") pod "adf98d06-7cb7-4d0d-99aa-e83e2851c0cd" (UID: "adf98d06-7cb7-4d0d-99aa-e83e2851c0cd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:50:15.735406 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.735292 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "adf98d06-7cb7-4d0d-99aa-e83e2851c0cd" (UID: "adf98d06-7cb7-4d0d-99aa-e83e2851c0cd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:50:15.735450 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.735429 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-kube-api-access-fdvzc" (OuterVolumeSpecName: "kube-api-access-fdvzc") pod "adf98d06-7cb7-4d0d-99aa-e83e2851c0cd" (UID: "adf98d06-7cb7-4d0d-99aa-e83e2851c0cd"). InnerVolumeSpecName "kube-api-access-fdvzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:50:15.834763 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.834726 2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-dshm\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:50:15.834763 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.834756 2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-tls-certs\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:50:15.834763 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.834776 2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-tmp-dir\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:50:15.835018 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:15.834789 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdvzc\" (UniqueName: \"kubernetes.io/projected/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd-kube-api-access-fdvzc\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:50:16.384005 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:16.383968 2582 generic.go:356] "Generic (PLEG): container finished" podID="adf98d06-7cb7-4d0d-99aa-e83e2851c0cd" containerID="9e55d5eee330a6c16f03289245614e8c3d8df9364eac9d2f83901a1188c3ab34" exitCode=0 Jul 06 14:50:16.384182 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:16.384013 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" Jul 06 14:50:16.384182 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:16.384015 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" event={"ID":"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd","Type":"ContainerDied","Data":"9e55d5eee330a6c16f03289245614e8c3d8df9364eac9d2f83901a1188c3ab34"} Jul 06 14:50:16.384182 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:16.384057 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d" event={"ID":"adf98d06-7cb7-4d0d-99aa-e83e2851c0cd","Type":"ContainerDied","Data":"10956affe9acaa1631ac656b9dfcd29d73d1833978281ab5ef80daf48ce257f4"} Jul 06 14:50:16.384182 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:16.384078 2582 scope.go:117] "RemoveContainer" containerID="9e55d5eee330a6c16f03289245614e8c3d8df9364eac9d2f83901a1188c3ab34" Jul 06 14:50:16.398564 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:16.398528 2582 scope.go:117] "RemoveContainer" containerID="9e55d5eee330a6c16f03289245614e8c3d8df9364eac9d2f83901a1188c3ab34" Jul 06 14:50:16.398919 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:50:16.398900 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e55d5eee330a6c16f03289245614e8c3d8df9364eac9d2f83901a1188c3ab34\": container with ID starting with 9e55d5eee330a6c16f03289245614e8c3d8df9364eac9d2f83901a1188c3ab34 not found: ID does not exist" containerID="9e55d5eee330a6c16f03289245614e8c3d8df9364eac9d2f83901a1188c3ab34" Jul 06 14:50:16.398962 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:16.398929 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e55d5eee330a6c16f03289245614e8c3d8df9364eac9d2f83901a1188c3ab34"} err="failed to get container status \"9e55d5eee330a6c16f03289245614e8c3d8df9364eac9d2f83901a1188c3ab34\": rpc error: code = NotFound desc = could not find container \"9e55d5eee330a6c16f03289245614e8c3d8df9364eac9d2f83901a1188c3ab34\": container with ID starting with 9e55d5eee330a6c16f03289245614e8c3d8df9364eac9d2f83901a1188c3ab34 not found: ID does not exist" Jul 06 14:50:16.424223 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:16.424194 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d"] Jul 06 14:50:16.444246 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:16.444219 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-ad48ac23/e2e-lifecycle-model-ad48ac23-kserve-686c5b4b75-jwb7d"] Jul 06 14:50:18.411820 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:18.411780 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adf98d06-7cb7-4d0d-99aa-e83e2851c0cd" path="/var/lib/kubelet/pods/adf98d06-7cb7-4d0d-99aa-e83e2851c0cd/volumes" Jul 06 14:50:37.663666 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:37.663622 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:40.327924 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:40.327890 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:40.944564 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:40.944523 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:50:47.532382 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:47.532342 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:47.666623 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:47.666584 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:47.817113 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:47.817028 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:48.062835 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:48.062799 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:49.236037 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:49.236003 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:49.374883 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:49.374837 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:50.226490 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:50.226452 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:50.348525 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:50.348492 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:51.966974 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:51.966938 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:52.003753 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:52.003722 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:50:58.730256 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:58.730214 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:58.826726 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:58.826692 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:59.438407 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:50:59.438371 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:03.760040 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:03.759951 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:51:06.373064 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:06.373028 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:06.591137 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:06.591082 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:06.736977 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:06.736879 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:17.260256 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:17.260208 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:17.538440 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:17.538402 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:38.519293 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:38.519241 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:45.129263 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:45.129222 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:45.277515 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:45.277477 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:45.502748 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:45.502629 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:45.942973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:45.942942 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:46.130392 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:46.130358 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:49.706309 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:49.706272 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:49.905876 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:49.905844 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:50.239467 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:50.239420 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:50.943911 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:50.943850 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:51.043566 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:51.043511 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:54.096006 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.095970 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:54.446956 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.446871 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:54.746938 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.746861 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65"] Jul 06 14:51:54.747223 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.747201 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf98d06-7cb7-4d0d-99aa-e83e2851c0cd" containerName="main" Jul 06 14:51:54.747272 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.747225 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf98d06-7cb7-4d0d-99aa-e83e2851c0cd" containerName="main" Jul 06 14:51:54.747319 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.747286 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf98d06-7cb7-4d0d-99aa-e83e2851c0cd" containerName="main" Jul 06 14:51:54.750608 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.750571 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.759496 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.759469 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-421cfb-openshift-default-dockercfg-fxv89\"" Jul 06 14:51:54.774356 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.774326 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65"] Jul 06 14:51:54.797067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.797029 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:54.821230 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.821185 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-envoy\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.821407 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.821271 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-token\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.821407 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.821309 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-workload-socket\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.821407 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.821334 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-workload-certs\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.821407 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.821381 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-credential-socket\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.821570 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.821424 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-podinfo\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.821570 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.821451 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v9bp\" (UniqueName: \"kubernetes.io/projected/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-kube-api-access-2v9bp\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.821570 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.821473 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-data\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.821570 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.821499 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istiod-ca-cert\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.922513 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.922470 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-token\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.922721 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.922532 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-workload-socket\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.922721 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.922577 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-workload-certs\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.922721 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.922606 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-credential-socket\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.922721 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.922638 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-podinfo\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.922721 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.922669 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v9bp\" (UniqueName: \"kubernetes.io/projected/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-kube-api-access-2v9bp\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.923005 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.922740 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-data\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.923005 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.922787 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istiod-ca-cert\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.923005 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.922843 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-envoy\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.923155 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.923010 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-workload-socket\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.923155 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.923028 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-credential-socket\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.923155 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.923050 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-workload-certs\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.923155 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.923129 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-data\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.923592 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.923573 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istiod-ca-cert\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.925669 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.925649 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-envoy\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.925990 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.925968 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-podinfo\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.932074 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.932046 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-token\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:54.932258 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:54.932237 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v9bp\" (UniqueName: \"kubernetes.io/projected/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-kube-api-access-2v9bp\") pod \"e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:55.061492 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:55.061450 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:55.125010 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:55.124933 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:55.211684 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:55.211660 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65"] Jul 06 14:51:55.213192 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:51:55.213166 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c3323fc_bb95_4065_ab54_c5b4a7afa2bc.slice/crio-6e2262d572884ae675d1cecb756ceb5e99708e253dc807f371d7de46b6cbf199 WatchSource:0}: Error finding container 6e2262d572884ae675d1cecb756ceb5e99708e253dc807f371d7de46b6cbf199: Status 404 returned error can't find the container with id 6e2262d572884ae675d1cecb756ceb5e99708e253dc807f371d7de46b6cbf199 Jul 06 14:51:55.215354 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:55.215324 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 14:51:55.215442 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:55.215390 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 14:51:55.215442 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:55.215419 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 14:51:55.427943 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:55.427851 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:51:55.875580 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:55.875523 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" event={"ID":"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc","Type":"ContainerStarted","Data":"7bfd9ecbddde62b616ef2f9f3148c09ebd27851a92e52a250bd5de121139136f"} Jul 06 14:51:55.875777 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:55.875607 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" event={"ID":"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc","Type":"ContainerStarted","Data":"6e2262d572884ae675d1cecb756ceb5e99708e253dc807f371d7de46b6cbf199"} Jul 06 14:51:55.904945 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:55.904867 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" podStartSLOduration=1.904850701 podStartE2EDuration="1.904850701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:51:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:51:55.903568949 +0000 UTC m=+1935.986862212" watchObservedRunningTime="2026-07-06 14:51:55.904850701 +0000 UTC m=+1935.988143972" Jul 06 14:51:56.062121 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:56.062084 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:56.067104 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:56.067077 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:56.881142 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:56.881099 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:56.882162 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:56.882146 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:51:58.100536 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:58.100501 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:58.211882 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:58.211827 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:58.316092 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:58.316061 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:58.534912 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:58.534881 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:59.068268 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:59.068239 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:59.168765 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:51:59.168734 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:02.511287 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:02.511252 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:03.601671 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:03.601639 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:52:07.292864 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.292827 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb"] Jul 06 14:52:07.297319 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.297301 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.301069 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.301050 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-3f9274\"/\"kube-root-ca.crt\"" Jul 06 14:52:07.301834 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.301812 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-3f9274\"/\"test-model-3f9274-kserve-self-signed-certs\"" Jul 06 14:52:07.302330 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.302315 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-3f9274\"/\"default-dockercfg-vfkqh\"" Jul 06 14:52:07.302411 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.302334 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-3f9274\"/\"openshift-service-ca.crt\"" Jul 06 14:52:07.330230 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.330202 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb"] Jul 06 14:52:07.412122 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.412094 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:07.438381 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.438344 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-home\") pod \"test-model-3f9274-kserve-55dc899899-mdphb\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.438576 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.438396 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-dshm\") pod \"test-model-3f9274-kserve-55dc899899-mdphb\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.438576 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.438470 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh8n8\" (UniqueName: \"kubernetes.io/projected/40bcaae8-1203-432f-b727-0891bf942206-kube-api-access-jh8n8\") pod \"test-model-3f9274-kserve-55dc899899-mdphb\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.438702 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.438583 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40bcaae8-1203-432f-b727-0891bf942206-tls-certs\") pod \"test-model-3f9274-kserve-55dc899899-mdphb\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.438702 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.438622 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-model-cache\") pod \"test-model-3f9274-kserve-55dc899899-mdphb\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.438702 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.438673 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-tmp-dir\") pod \"test-model-3f9274-kserve-55dc899899-mdphb\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.539417 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.539376 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-dshm\") pod \"test-model-3f9274-kserve-55dc899899-mdphb\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.539686 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.539610 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh8n8\" (UniqueName: \"kubernetes.io/projected/40bcaae8-1203-432f-b727-0891bf942206-kube-api-access-jh8n8\") pod \"test-model-3f9274-kserve-55dc899899-mdphb\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.539686 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.539671 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40bcaae8-1203-432f-b727-0891bf942206-tls-certs\") pod \"test-model-3f9274-kserve-55dc899899-mdphb\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.539833 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.539697 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-model-cache\") pod \"test-model-3f9274-kserve-55dc899899-mdphb\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.539833 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.539713 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-tmp-dir\") pod \"test-model-3f9274-kserve-55dc899899-mdphb\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.539833 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.539804 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-home\") pod \"test-model-3f9274-kserve-55dc899899-mdphb\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.540117 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.540095 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-tmp-dir\") pod \"test-model-3f9274-kserve-55dc899899-mdphb\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.540212 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.540187 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-model-cache\") pod \"test-model-3f9274-kserve-55dc899899-mdphb\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.540318 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.540291 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-home\") pod \"test-model-3f9274-kserve-55dc899899-mdphb\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.542073 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.542050 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-dshm\") pod \"test-model-3f9274-kserve-55dc899899-mdphb\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.542318 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.542301 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40bcaae8-1203-432f-b727-0891bf942206-tls-certs\") pod \"test-model-3f9274-kserve-55dc899899-mdphb\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.552251 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.552176 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh8n8\" (UniqueName: \"kubernetes.io/projected/40bcaae8-1203-432f-b727-0891bf942206-kube-api-access-jh8n8\") pod \"test-model-3f9274-kserve-55dc899899-mdphb\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.607146 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.607104 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:07.790988 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.790943 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb"] Jul 06 14:52:07.793421 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:52:07.793391 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40bcaae8_1203_432f_b727_0891bf942206.slice/crio-a06cd71399bb736cc8077692c318d92d722265bf581a8d4dda9d2902e2a05760 WatchSource:0}: Error finding container a06cd71399bb736cc8077692c318d92d722265bf581a8d4dda9d2902e2a05760: Status 404 returned error can't find the container with id a06cd71399bb736cc8077692c318d92d722265bf581a8d4dda9d2902e2a05760 Jul 06 14:52:07.937526 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.937485 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" event={"ID":"40bcaae8-1203-432f-b727-0891bf942206","Type":"ContainerStarted","Data":"eb13b32bdc685606d9ae09e4203c17cf2e715390cffe15ce9336b631f95aa022"} Jul 06 14:52:07.937741 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:07.937537 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" event={"ID":"40bcaae8-1203-432f-b727-0891bf942206","Type":"ContainerStarted","Data":"a06cd71399bb736cc8077692c318d92d722265bf581a8d4dda9d2902e2a05760"} Jul 06 14:52:11.882381 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:11.882345 2582 patch_prober.go:28] interesting pod/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 06 14:52:11.882846 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:11.882400 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" podUID="9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 06 14:52:11.960592 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:11.960542 2582 generic.go:356] "Generic (PLEG): container finished" podID="9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" containerID="7bfd9ecbddde62b616ef2f9f3148c09ebd27851a92e52a250bd5de121139136f" exitCode=0 Jul 06 14:52:11.960774 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:11.960627 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" event={"ID":"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc","Type":"ContainerDied","Data":"7bfd9ecbddde62b616ef2f9f3148c09ebd27851a92e52a250bd5de121139136f"} Jul 06 14:52:11.961148 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:11.961132 2582 scope.go:117] "RemoveContainer" containerID="7bfd9ecbddde62b616ef2f9f3148c09ebd27851a92e52a250bd5de121139136f" Jul 06 14:52:11.962372 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:11.962346 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 14:52:11.962444 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:11.962423 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 14:52:11.962485 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:11.962455 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 14:52:11.995633 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:11.990905 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" podStartSLOduration=4.990883738 podStartE2EDuration="4.990883738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:52:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:52:07.969781144 +0000 UTC m=+1948.053074417" watchObservedRunningTime="2026-07-06 14:52:11.990883738 +0000 UTC m=+1952.074177010" Jul 06 14:52:12.093860 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:12.093820 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:12.226330 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:12.226236 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:12.974573 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:12.974519 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" event={"ID":"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc","Type":"ContainerStarted","Data":"1ca01e6b853f2f82690a496dc587eb167f432b2a839cfba7e95cd25e23598ca1"} Jul 06 14:52:13.062766 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:13.062726 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:52:13.063073 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:13.062763 2582 patch_prober.go:28] interesting pod/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 06 14:52:13.063251 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:13.063228 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" podUID="9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 06 14:52:14.062060 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:14.062016 2582 patch_prober.go:28] interesting pod/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 06 14:52:14.062673 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:14.062638 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" podUID="9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 06 14:52:15.062653 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:15.062616 2582 patch_prober.go:28] interesting pod/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 06 14:52:15.063303 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:15.063268 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" podUID="9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 06 14:52:16.062724 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:16.062684 2582 patch_prober.go:28] interesting pod/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 06 14:52:16.063355 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:16.063324 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" podUID="9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 06 14:52:17.065758 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:17.065727 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:52:17.066149 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:17.066093 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:52:17.066860 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:17.066838 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:52:17.607973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:17.607930 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:17.608198 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:17.607987 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:17.620395 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:17.620366 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:18.010901 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:18.010816 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:52:18.620327 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:18.620281 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:20.533584 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:20.533530 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:52:21.289796 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:21.289762 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:21.396294 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:21.396258 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:42.267529 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:42.267440 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:46.434938 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:52:46.434904 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:53:01.113229 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:01.113191 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb"] Jul 06 14:53:01.136080 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:01.136026 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:02.086208 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:02.086161 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:02.314250 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:02.314173 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:02.339728 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:02.339642 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:53:02.708012 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:02.707920 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:02.871411 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:02.871378 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:02.969762 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:02.969662 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:03.144370 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:03.144334 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:07.780557 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:07.780524 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:12.811483 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:12.811447 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:53:16.133561 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.133487 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" podUID="40bcaae8-1203-432f-b727-0891bf942206" containerName="main" containerID="cri-o://eb13b32bdc685606d9ae09e4203c17cf2e715390cffe15ce9336b631f95aa022" gracePeriod=45 Jul 06 14:53:16.304940 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.304879 2582 generic.go:356] "Generic (PLEG): container finished" podID="40bcaae8-1203-432f-b727-0891bf942206" containerID="eb13b32bdc685606d9ae09e4203c17cf2e715390cffe15ce9336b631f95aa022" exitCode=0 Jul 06 14:53:16.305082 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.305053 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" event={"ID":"40bcaae8-1203-432f-b727-0891bf942206","Type":"ContainerDied","Data":"eb13b32bdc685606d9ae09e4203c17cf2e715390cffe15ce9336b631f95aa022"} Jul 06 14:53:16.385889 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.385825 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:53:16.464883 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.464842 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-dshm\") pod \"40bcaae8-1203-432f-b727-0891bf942206\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " Jul 06 14:53:16.465044 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.464908 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40bcaae8-1203-432f-b727-0891bf942206-tls-certs\") pod \"40bcaae8-1203-432f-b727-0891bf942206\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " Jul 06 14:53:16.465044 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.464953 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh8n8\" (UniqueName: \"kubernetes.io/projected/40bcaae8-1203-432f-b727-0891bf942206-kube-api-access-jh8n8\") pod \"40bcaae8-1203-432f-b727-0891bf942206\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " Jul 06 14:53:16.465044 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.464992 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-tmp-dir\") pod \"40bcaae8-1203-432f-b727-0891bf942206\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " Jul 06 14:53:16.465218 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.465043 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-home\") pod \"40bcaae8-1203-432f-b727-0891bf942206\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " Jul 06 14:53:16.465218 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.465069 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-model-cache\") pod \"40bcaae8-1203-432f-b727-0891bf942206\" (UID: \"40bcaae8-1203-432f-b727-0891bf942206\") " Jul 06 14:53:16.465352 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.465314 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-home" (OuterVolumeSpecName: "home") pod "40bcaae8-1203-432f-b727-0891bf942206" (UID: "40bcaae8-1203-432f-b727-0891bf942206"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:53:16.465410 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.465329 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "40bcaae8-1203-432f-b727-0891bf942206" (UID: "40bcaae8-1203-432f-b727-0891bf942206"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:53:16.465510 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.465492 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-model-cache" (OuterVolumeSpecName: "model-cache") pod "40bcaae8-1203-432f-b727-0891bf942206" (UID: "40bcaae8-1203-432f-b727-0891bf942206"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:53:16.467369 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.467346 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40bcaae8-1203-432f-b727-0891bf942206-kube-api-access-jh8n8" (OuterVolumeSpecName: "kube-api-access-jh8n8") pod "40bcaae8-1203-432f-b727-0891bf942206" (UID: "40bcaae8-1203-432f-b727-0891bf942206"). InnerVolumeSpecName "kube-api-access-jh8n8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:53:16.467524 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.467509 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40bcaae8-1203-432f-b727-0891bf942206-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "40bcaae8-1203-432f-b727-0891bf942206" (UID: "40bcaae8-1203-432f-b727-0891bf942206"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:53:16.467599 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.467516 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-dshm" (OuterVolumeSpecName: "dshm") pod "40bcaae8-1203-432f-b727-0891bf942206" (UID: "40bcaae8-1203-432f-b727-0891bf942206"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:53:16.566381 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.566327 2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40bcaae8-1203-432f-b727-0891bf942206-tls-certs\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:53:16.566381 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.566373 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh8n8\" (UniqueName: \"kubernetes.io/projected/40bcaae8-1203-432f-b727-0891bf942206-kube-api-access-jh8n8\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:53:16.566381 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.566386 2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-tmp-dir\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:53:16.566685 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.566399 2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-home\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:53:16.566685 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.566410 2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-model-cache\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:53:16.566685 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:16.566423 2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40bcaae8-1203-432f-b727-0891bf942206-dshm\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:53:17.311446 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:17.311416 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" event={"ID":"40bcaae8-1203-432f-b727-0891bf942206","Type":"ContainerDied","Data":"a06cd71399bb736cc8077692c318d92d722265bf581a8d4dda9d2902e2a05760"} Jul 06 14:53:17.311446 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:17.311447 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb" Jul 06 14:53:17.311975 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:17.311466 2582 scope.go:117] "RemoveContainer" containerID="eb13b32bdc685606d9ae09e4203c17cf2e715390cffe15ce9336b631f95aa022" Jul 06 14:53:17.338274 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:17.338238 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb"] Jul 06 14:53:17.343716 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:17.343688 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-3f9274/test-model-3f9274-kserve-55dc899899-mdphb"] Jul 06 14:53:18.412670 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:18.412630 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40bcaae8-1203-432f-b727-0891bf942206" path="/var/lib/kubelet/pods/40bcaae8-1203-432f-b727-0891bf942206/volumes" Jul 06 14:53:26.043677 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:26.043633 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:26.149927 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:26.149888 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:45.069018 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:45.068979 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:45.385221 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:45.385119 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:45.611532 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:45.611497 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:45.815017 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:45.814981 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:46.196763 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:46.196681 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:46.365346 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:46.365314 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:46.457246 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:46.457147 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:46.643857 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:46.643828 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:49.128754 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:49.128716 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:53:52.974245 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:52.974204 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:53.053041 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:53.053008 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:53.255459 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:53.255368 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65"] Jul 06 14:53:53.255646 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:53.255627 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" podUID="9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" containerName="istio-proxy" containerID="cri-o://1ca01e6b853f2f82690a496dc587eb167f432b2a839cfba7e95cd25e23598ca1" gracePeriod=30 Jul 06 14:53:53.286723 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:53.286685 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:53.500865 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:53.500828 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:53.845064 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:53.845030 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:54.169575 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:54.169455 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:54.453630 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:54.453531 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:57.138363 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:57.138319 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:57.227203 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:57.227151 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:57.333260 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:57.333218 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:57.456837 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:57.456749 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:57.729740 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:57.729654 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:57.830136 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:57.830102 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:58.506398 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.506375 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:53:58.518515 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.518451 2582 generic.go:356] "Generic (PLEG): container finished" podID="9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" containerID="1ca01e6b853f2f82690a496dc587eb167f432b2a839cfba7e95cd25e23598ca1" exitCode=0 Jul 06 14:53:58.518515 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.518491 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" Jul 06 14:53:58.518515 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.518491 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" event={"ID":"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc","Type":"ContainerDied","Data":"1ca01e6b853f2f82690a496dc587eb167f432b2a839cfba7e95cd25e23598ca1"} Jul 06 14:53:58.518764 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.518569 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65" event={"ID":"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc","Type":"ContainerDied","Data":"6e2262d572884ae675d1cecb756ceb5e99708e253dc807f371d7de46b6cbf199"} Jul 06 14:53:58.518764 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.518602 2582 scope.go:117] "RemoveContainer" containerID="1ca01e6b853f2f82690a496dc587eb167f432b2a839cfba7e95cd25e23598ca1" Jul 06 14:53:58.526899 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.526880 2582 scope.go:117] "RemoveContainer" containerID="7bfd9ecbddde62b616ef2f9f3148c09ebd27851a92e52a250bd5de121139136f" Jul 06 14:53:58.537142 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.537115 2582 scope.go:117] "RemoveContainer" containerID="1ca01e6b853f2f82690a496dc587eb167f432b2a839cfba7e95cd25e23598ca1" Jul 06 14:53:58.537522 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:53:58.537497 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ca01e6b853f2f82690a496dc587eb167f432b2a839cfba7e95cd25e23598ca1\": container with ID starting with 1ca01e6b853f2f82690a496dc587eb167f432b2a839cfba7e95cd25e23598ca1 not found: ID does not exist" containerID="1ca01e6b853f2f82690a496dc587eb167f432b2a839cfba7e95cd25e23598ca1" Jul 06 14:53:58.537644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.537537 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca01e6b853f2f82690a496dc587eb167f432b2a839cfba7e95cd25e23598ca1"} err="failed to get container status \"1ca01e6b853f2f82690a496dc587eb167f432b2a839cfba7e95cd25e23598ca1\": rpc error: code = NotFound desc = could not find container \"1ca01e6b853f2f82690a496dc587eb167f432b2a839cfba7e95cd25e23598ca1\": container with ID starting with 1ca01e6b853f2f82690a496dc587eb167f432b2a839cfba7e95cd25e23598ca1 not found: ID does not exist" Jul 06 14:53:58.537644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.537598 2582 scope.go:117] "RemoveContainer" containerID="7bfd9ecbddde62b616ef2f9f3148c09ebd27851a92e52a250bd5de121139136f" Jul 06 14:53:58.537897 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:53:58.537879 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bfd9ecbddde62b616ef2f9f3148c09ebd27851a92e52a250bd5de121139136f\": container with ID starting with 7bfd9ecbddde62b616ef2f9f3148c09ebd27851a92e52a250bd5de121139136f not found: ID does not exist" containerID="7bfd9ecbddde62b616ef2f9f3148c09ebd27851a92e52a250bd5de121139136f" Jul 06 14:53:58.537957 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.537916 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bfd9ecbddde62b616ef2f9f3148c09ebd27851a92e52a250bd5de121139136f"} err="failed to get container status \"7bfd9ecbddde62b616ef2f9f3148c09ebd27851a92e52a250bd5de121139136f\": rpc error: code = NotFound desc = could not find container \"7bfd9ecbddde62b616ef2f9f3148c09ebd27851a92e52a250bd5de121139136f\": container with ID starting with 7bfd9ecbddde62b616ef2f9f3148c09ebd27851a92e52a250bd5de121139136f not found: ID does not exist" Jul 06 14:53:58.644100 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.644062 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2v9bp\" (UniqueName: \"kubernetes.io/projected/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-kube-api-access-2v9bp\") pod \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " Jul 06 14:53:58.644298 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.644109 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-data\") pod \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " Jul 06 14:53:58.644298 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.644146 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-workload-certs\") pod \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " Jul 06 14:53:58.644298 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.644167 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-podinfo\") pod \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " Jul 06 14:53:58.644298 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.644213 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istiod-ca-cert\") pod \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " Jul 06 14:53:58.644298 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.644239 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-envoy\") pod \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " Jul 06 14:53:58.644298 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.644295 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-credential-socket\") pod \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " Jul 06 14:53:58.644648 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.644322 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-token\") pod \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " Jul 06 14:53:58.644648 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.644399 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-workload-socket\") pod \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\" (UID: \"9c3323fc-bb95-4065-ab54-c5b4a7afa2bc\") " Jul 06 14:53:58.644648 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.644502 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" (UID: "9c3323fc-bb95-4065-ab54-c5b4a7afa2bc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:53:58.644648 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.644603 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" (UID: "9c3323fc-bb95-4065-ab54-c5b4a7afa2bc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:53:58.644841 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.644745 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" (UID: "9c3323fc-bb95-4065-ab54-c5b4a7afa2bc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:53:58.644841 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.644794 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" (UID: "9c3323fc-bb95-4065-ab54-c5b4a7afa2bc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:53:58.644841 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.644829 2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-workload-certs\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:53:58.644947 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.644854 2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istiod-ca-cert\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:53:58.644947 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.644869 2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-workload-socket\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:53:58.645304 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.645275 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-data" (OuterVolumeSpecName: "istio-data") pod "9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" (UID: "9c3323fc-bb95-4065-ab54-c5b4a7afa2bc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:53:58.646605 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.646570 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" (UID: "9c3323fc-bb95-4065-ab54-c5b4a7afa2bc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 14:53:58.646720 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.646630 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" (UID: "9c3323fc-bb95-4065-ab54-c5b4a7afa2bc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:53:58.646720 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.646668 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-kube-api-access-2v9bp" (OuterVolumeSpecName: "kube-api-access-2v9bp") pod "9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" (UID: "9c3323fc-bb95-4065-ab54-c5b4a7afa2bc"). InnerVolumeSpecName "kube-api-access-2v9bp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:53:58.646869 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.646850 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-token" (OuterVolumeSpecName: "istio-token") pod "9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" (UID: "9c3323fc-bb95-4065-ab54-c5b4a7afa2bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:53:58.745921 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.745887 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2v9bp\" (UniqueName: \"kubernetes.io/projected/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-kube-api-access-2v9bp\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:53:58.745921 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.745915 2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-data\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:53:58.745921 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.745924 2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-podinfo\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:53:58.745921 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.745932 2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-envoy\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:53:58.746188 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.745940 2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-credential-socket\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:53:58.746188 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.745948 2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc-istio-token\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:53:58.843801 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.843764 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65"] Jul 06 14:53:58.845828 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:53:58.845804 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-421cfb-openshift-default-669d59655f-g9q65"] Jul 06 14:54:00.418696 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:00.418664 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" path="/var/lib/kubelet/pods/9c3323fc-bb95-4065-ab54-c5b4a7afa2bc/volumes" Jul 06 14:54:01.680106 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:01.680063 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:01.697995 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:01.697956 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:54:02.087426 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:02.087395 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:02.516321 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:02.516195 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:02.620977 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:02.620945 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:05.316135 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:05.316090 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:05.413031 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:05.412998 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:05.509122 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:05.509089 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:05.610330 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:05.610243 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:06.128796 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:06.128757 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:06.257226 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:06.257188 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:09.709136 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:09.709101 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:12.621462 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:12.621426 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:54:17.981984 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:17.981937 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:18.330097 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:18.330062 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:18.453423 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:18.453357 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:18.552186 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:18.552152 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:18.740447 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:18.740362 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:20.190508 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:20.190470 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:23.017898 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:23.017863 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:54:24.791272 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:24.791236 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:24.890172 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:24.890140 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:25.088642 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:25.088536 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:25.282109 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:25.282062 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:25.539693 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:25.539659 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:25.887504 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:25.887416 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:25.993650 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:25.993595 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:26.089413 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:26.089379 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:26.263734 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:26.263649 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:27.178989 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:27.178956 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:32.122982 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:32.122949 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:32.225323 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:32.225287 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:32.354121 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:32.354089 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:32.580030 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:32.579976 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:32.907765 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:32.907674 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:33.233753 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:33.233665 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:33.329423 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:33.329388 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:35.726305 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:35.726269 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:54:36.450425 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:36.450388 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:36.568046 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:36.567989 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:36.664309 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:36.664278 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:36.994986 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:36.994943 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:37.091450 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:37.091419 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:37.191528 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:37.191493 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:40.851620 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:40.851586 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:41.221712 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:41.221629 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:41.536134 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:41.536104 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:41.697351 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:41.697319 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:44.387087 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:44.387056 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:44.471349 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:44.471316 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:44.566610 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:44.566537 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:45.023871 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:45.023834 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:45.121324 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:45.121288 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:45.220921 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:45.220886 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:46.012767 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:46.012728 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:54:48.082335 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:48.082301 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:48.908065 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:48.908026 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:53.717109 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:53.717072 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:54:57.812445 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:57.812408 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:57.913046 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:54:57.913014 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:05.985154 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:05.985118 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:06.129296 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.129262 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:06.543716 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.543683 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b"] Jul 06 14:55:06.544039 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.543996 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40bcaae8-1203-432f-b727-0891bf942206" containerName="main" Jul 06 14:55:06.544084 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.544042 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="40bcaae8-1203-432f-b727-0891bf942206" containerName="main" Jul 06 14:55:06.544084 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.544051 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" containerName="istio-proxy" Jul 06 14:55:06.544084 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.544057 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" containerName="istio-proxy" Jul 06 14:55:06.544179 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.544124 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" containerName="istio-proxy" Jul 06 14:55:06.544179 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.544134 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="40bcaae8-1203-432f-b727-0891bf942206" containerName="main" Jul 06 14:55:06.547233 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.547213 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.550987 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.550962 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bb4316\"/\"openshift-service-ca.crt\"" Jul 06 14:55:06.551123 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.551016 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bb4316\"/\"kube-root-ca.crt\"" Jul 06 14:55:06.552074 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.552061 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bb4316\"/\"default-dockercfg-49h5w\"" Jul 06 14:55:06.552133 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.552094 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bb4316\"/\"auth-test-model-bb4316-kserve-self-signed-certs\"" Jul 06 14:55:06.559088 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.559064 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b"] Jul 06 14:55:06.580298 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.580269 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:06.640026 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.639993 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-model-cache\") pod \"auth-test-model-bb4316-kserve-6696c78ff5-r5t8b\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.640205 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.640041 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-tmp-dir\") pod \"auth-test-model-bb4316-kserve-6696c78ff5-r5t8b\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.640205 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.640067 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3145282b-f355-454b-bd94-f66b359c726e-tls-certs\") pod \"auth-test-model-bb4316-kserve-6696c78ff5-r5t8b\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.640205 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.640084 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt58g\" (UniqueName: \"kubernetes.io/projected/3145282b-f355-454b-bd94-f66b359c726e-kube-api-access-qt58g\") pod \"auth-test-model-bb4316-kserve-6696c78ff5-r5t8b\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.640205 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.640155 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-home\") pod \"auth-test-model-bb4316-kserve-6696c78ff5-r5t8b\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.640205 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.640199 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-dshm\") pod \"auth-test-model-bb4316-kserve-6696c78ff5-r5t8b\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.741121 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.741086 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-home\") pod \"auth-test-model-bb4316-kserve-6696c78ff5-r5t8b\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.741314 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.741133 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-dshm\") pod \"auth-test-model-bb4316-kserve-6696c78ff5-r5t8b\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.741314 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.741180 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-model-cache\") pod \"auth-test-model-bb4316-kserve-6696c78ff5-r5t8b\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.741314 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.741231 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-tmp-dir\") pod \"auth-test-model-bb4316-kserve-6696c78ff5-r5t8b\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.741314 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.741262 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3145282b-f355-454b-bd94-f66b359c726e-tls-certs\") pod \"auth-test-model-bb4316-kserve-6696c78ff5-r5t8b\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.741515 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.741409 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt58g\" (UniqueName: \"kubernetes.io/projected/3145282b-f355-454b-bd94-f66b359c726e-kube-api-access-qt58g\") pod \"auth-test-model-bb4316-kserve-6696c78ff5-r5t8b\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.741599 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.741538 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-home\") pod \"auth-test-model-bb4316-kserve-6696c78ff5-r5t8b\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.741700 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.741680 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-model-cache\") pod \"auth-test-model-bb4316-kserve-6696c78ff5-r5t8b\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.741743 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.741714 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-tmp-dir\") pod \"auth-test-model-bb4316-kserve-6696c78ff5-r5t8b\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.743642 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.743612 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-dshm\") pod \"auth-test-model-bb4316-kserve-6696c78ff5-r5t8b\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.743944 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.743925 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3145282b-f355-454b-bd94-f66b359c726e-tls-certs\") pod \"auth-test-model-bb4316-kserve-6696c78ff5-r5t8b\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.751194 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.751173 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt58g\" (UniqueName: \"kubernetes.io/projected/3145282b-f355-454b-bd94-f66b359c726e-kube-api-access-qt58g\") pod \"auth-test-model-bb4316-kserve-6696c78ff5-r5t8b\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.856642 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.856529 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:06.999000 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:06.998968 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b"] Jul 06 14:55:07.000894 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:55:07.000862 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3145282b_f355_454b_bd94_f66b359c726e.slice/crio-f8dd0bf247fdf22fd7ade3390f35bfec75bd426dc785d4072f3d381cff1dde41 WatchSource:0}: Error finding container f8dd0bf247fdf22fd7ade3390f35bfec75bd426dc785d4072f3d381cff1dde41: Status 404 returned error can't find the container with id f8dd0bf247fdf22fd7ade3390f35bfec75bd426dc785d4072f3d381cff1dde41 Jul 06 14:55:07.866787 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:07.866740 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" event={"ID":"3145282b-f355-454b-bd94-f66b359c726e","Type":"ContainerStarted","Data":"43f06716705593560fb28e177cb517f6b1519c89424c407264a482e4fbcf740f"} Jul 06 14:55:07.866982 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:07.866804 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" event={"ID":"3145282b-f355-454b-bd94-f66b359c726e","Type":"ContainerStarted","Data":"f8dd0bf247fdf22fd7ade3390f35bfec75bd426dc785d4072f3d381cff1dde41"} Jul 06 14:55:07.887372 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:07.887205 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" podStartSLOduration=1.887190703 podStartE2EDuration="1.887190703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:55:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:55:07.886668972 +0000 UTC m=+2127.969962249" watchObservedRunningTime="2026-07-06 14:55:07.887190703 +0000 UTC m=+2127.970484001" Jul 06 14:55:10.120678 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:10.120642 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:55:16.857329 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:16.857281 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:16.857329 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:16.857336 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:16.869825 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:16.869797 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:16.920491 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:16.920461 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:55:28.044290 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:28.044258 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:31.308951 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:31.308916 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:55:46.423202 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:46.423122 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:55:55.383574 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:55:55.383498 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:01.135101 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:56:01.135068 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:56:18.313217 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:56:18.313179 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:56:35.045777 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:56:35.045739 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:56:52.111973 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:56:52.111939 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:57:07.642518 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:07.642485 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:57:22.959219 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:22.959182 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:57:26.878351 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:26.878319 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b"] Jul 06 14:57:26.943718 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:26.943688 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:28.163676 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:28.163645 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:39.022668 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:39.022632 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:57:41.898046 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:41.897979 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" podUID="3145282b-f355-454b-bd94-f66b359c726e" containerName="main" containerID="cri-o://43f06716705593560fb28e177cb517f6b1519c89424c407264a482e4fbcf740f" gracePeriod=45 Jul 06 14:57:42.143185 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.143157 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:57:42.234929 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.234839 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-dshm\") pod \"3145282b-f355-454b-bd94-f66b359c726e\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " Jul 06 14:57:42.234929 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.234883 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-home\") pod \"3145282b-f355-454b-bd94-f66b359c726e\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " Jul 06 14:57:42.234929 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.234907 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-model-cache\") pod \"3145282b-f355-454b-bd94-f66b359c726e\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " Jul 06 14:57:42.235196 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.234950 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-tmp-dir\") pod \"3145282b-f355-454b-bd94-f66b359c726e\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " Jul 06 14:57:42.235196 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.234992 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3145282b-f355-454b-bd94-f66b359c726e-tls-certs\") pod \"3145282b-f355-454b-bd94-f66b359c726e\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " Jul 06 14:57:42.235196 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.235025 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qt58g\" (UniqueName: \"kubernetes.io/projected/3145282b-f355-454b-bd94-f66b359c726e-kube-api-access-qt58g\") pod \"3145282b-f355-454b-bd94-f66b359c726e\" (UID: \"3145282b-f355-454b-bd94-f66b359c726e\") " Jul 06 14:57:42.235196 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.235171 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-model-cache" (OuterVolumeSpecName: "model-cache") pod "3145282b-f355-454b-bd94-f66b359c726e" (UID: "3145282b-f355-454b-bd94-f66b359c726e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:57:42.235196 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.235161 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-home" (OuterVolumeSpecName: "home") pod "3145282b-f355-454b-bd94-f66b359c726e" (UID: "3145282b-f355-454b-bd94-f66b359c726e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:57:42.235456 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.235222 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3145282b-f355-454b-bd94-f66b359c726e" (UID: "3145282b-f355-454b-bd94-f66b359c726e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:57:42.235456 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.235293 2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-home\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:57:42.235456 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.235309 2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-model-cache\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:57:42.235456 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.235319 2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-tmp-dir\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:57:42.237305 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.237277 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3145282b-f355-454b-bd94-f66b359c726e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3145282b-f355-454b-bd94-f66b359c726e" (UID: "3145282b-f355-454b-bd94-f66b359c726e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:57:42.237305 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.237285 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-dshm" (OuterVolumeSpecName: "dshm") pod "3145282b-f355-454b-bd94-f66b359c726e" (UID: "3145282b-f355-454b-bd94-f66b359c726e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:57:42.237426 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.237318 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3145282b-f355-454b-bd94-f66b359c726e-kube-api-access-qt58g" (OuterVolumeSpecName: "kube-api-access-qt58g") pod "3145282b-f355-454b-bd94-f66b359c726e" (UID: "3145282b-f355-454b-bd94-f66b359c726e"). InnerVolumeSpecName "kube-api-access-qt58g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:57:42.336263 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.336221 2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3145282b-f355-454b-bd94-f66b359c726e-tls-certs\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:57:42.336263 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.336260 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qt58g\" (UniqueName: \"kubernetes.io/projected/3145282b-f355-454b-bd94-f66b359c726e-kube-api-access-qt58g\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:57:42.336263 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.336271 2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3145282b-f355-454b-bd94-f66b359c726e-dshm\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:57:42.643304 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.643269 2582 generic.go:356] "Generic (PLEG): container finished" podID="3145282b-f355-454b-bd94-f66b359c726e" containerID="43f06716705593560fb28e177cb517f6b1519c89424c407264a482e4fbcf740f" exitCode=0 Jul 06 14:57:42.643493 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.643316 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" Jul 06 14:57:42.643493 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.643362 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" event={"ID":"3145282b-f355-454b-bd94-f66b359c726e","Type":"ContainerDied","Data":"43f06716705593560fb28e177cb517f6b1519c89424c407264a482e4fbcf740f"} Jul 06 14:57:42.643493 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.643407 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b" event={"ID":"3145282b-f355-454b-bd94-f66b359c726e","Type":"ContainerDied","Data":"f8dd0bf247fdf22fd7ade3390f35bfec75bd426dc785d4072f3d381cff1dde41"} Jul 06 14:57:42.643493 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.643427 2582 scope.go:117] "RemoveContainer" containerID="43f06716705593560fb28e177cb517f6b1519c89424c407264a482e4fbcf740f" Jul 06 14:57:42.652893 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.652874 2582 scope.go:117] "RemoveContainer" containerID="43f06716705593560fb28e177cb517f6b1519c89424c407264a482e4fbcf740f" Jul 06 14:57:42.653182 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:57:42.653165 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43f06716705593560fb28e177cb517f6b1519c89424c407264a482e4fbcf740f\": container with ID starting with 43f06716705593560fb28e177cb517f6b1519c89424c407264a482e4fbcf740f not found: ID does not exist" containerID="43f06716705593560fb28e177cb517f6b1519c89424c407264a482e4fbcf740f" Jul 06 14:57:42.653240 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.653189 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43f06716705593560fb28e177cb517f6b1519c89424c407264a482e4fbcf740f"} err="failed to get container status \"43f06716705593560fb28e177cb517f6b1519c89424c407264a482e4fbcf740f\": rpc error: code = NotFound desc = could not find container \"43f06716705593560fb28e177cb517f6b1519c89424c407264a482e4fbcf740f\": container with ID starting with 43f06716705593560fb28e177cb517f6b1519c89424c407264a482e4fbcf740f not found: ID does not exist" Jul 06 14:57:42.661036 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.661008 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b"] Jul 06 14:57:42.667189 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.667167 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bb4316/auth-test-model-bb4316-kserve-6696c78ff5-r5t8b"] Jul 06 14:57:42.956279 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.956181 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx"] Jul 06 14:57:42.956773 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.956753 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3145282b-f355-454b-bd94-f66b359c726e" containerName="main" Jul 06 14:57:42.956773 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.956773 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3145282b-f355-454b-bd94-f66b359c726e" containerName="main" Jul 06 14:57:42.956891 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.956793 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" containerName="istio-proxy" Jul 06 14:57:42.956891 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.956801 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" containerName="istio-proxy" Jul 06 14:57:42.956987 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.956895 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c3323fc-bb95-4065-ab54-c5b4a7afa2bc" containerName="istio-proxy" Jul 06 14:57:42.956987 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.956908 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3145282b-f355-454b-bd94-f66b359c726e" containerName="main" Jul 06 14:57:42.961393 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.961372 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:42.965511 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.965488 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bb4316\"/\"openshift-service-ca.crt\"" Jul 06 14:57:42.965511 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.965490 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bb4316\"/\"sub-test-model-bb4316-kserve-self-signed-certs\"" Jul 06 14:57:42.965758 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.965536 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bb4316\"/\"kube-root-ca.crt\"" Jul 06 14:57:42.965758 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.965509 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bb4316\"/\"default-dockercfg-49h5w\"" Jul 06 14:57:42.970663 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.970638 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx"] Jul 06 14:57:42.982070 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:42.982033 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:43.042336 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.042300 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-home\") pod \"sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.042336 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.042336 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpz4n\" (UniqueName: \"kubernetes.io/projected/28777f32-2d59-484f-868b-d6774637578e-kube-api-access-wpz4n\") pod \"sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.042514 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.042378 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28777f32-2d59-484f-868b-d6774637578e-tls-certs\") pod \"sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.042514 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.042421 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-tmp-dir\") pod \"sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.042514 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.042481 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-dshm\") pod \"sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.042652 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.042532 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-model-cache\") pod \"sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.143753 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.143710 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-model-cache\") pod \"sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.143967 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.143772 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-home\") pod \"sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.143967 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.143794 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpz4n\" (UniqueName: \"kubernetes.io/projected/28777f32-2d59-484f-868b-d6774637578e-kube-api-access-wpz4n\") pod \"sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.143967 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.143834 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28777f32-2d59-484f-868b-d6774637578e-tls-certs\") pod \"sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.143967 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.143858 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-tmp-dir\") pod \"sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.143967 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.143898 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-dshm\") pod \"sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.144235 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.144184 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-model-cache\") pod \"sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.144235 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.144199 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-home\") pod \"sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.144331 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.144238 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-tmp-dir\") pod \"sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.146257 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.146233 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-dshm\") pod \"sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.146506 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.146465 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28777f32-2d59-484f-868b-d6774637578e-tls-certs\") pod \"sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.154080 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.154056 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpz4n\" (UniqueName: \"kubernetes.io/projected/28777f32-2d59-484f-868b-d6774637578e-kube-api-access-wpz4n\") pod \"sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.271698 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.271601 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:43.418944 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.418909 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx"] Jul 06 14:57:43.419282 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:57:43.419258 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28777f32_2d59_484f_868b_d6774637578e.slice/crio-afce057abd69ea8f3c6cec336d0f299520906b2fe55c3e447193e2a6127fa9d1 WatchSource:0}: Error finding container afce057abd69ea8f3c6cec336d0f299520906b2fe55c3e447193e2a6127fa9d1: Status 404 returned error can't find the container with id afce057abd69ea8f3c6cec336d0f299520906b2fe55c3e447193e2a6127fa9d1 Jul 06 14:57:43.652365 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.652324 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" event={"ID":"28777f32-2d59-484f-868b-d6774637578e","Type":"ContainerStarted","Data":"bed065b15ca4ed8e79cfa150ab4ec1cc5f4ba55924e8063e698d8ba4d789b17c"} Jul 06 14:57:43.652365 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.652377 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" event={"ID":"28777f32-2d59-484f-868b-d6774637578e","Type":"ContainerStarted","Data":"afce057abd69ea8f3c6cec336d0f299520906b2fe55c3e447193e2a6127fa9d1"} Jul 06 14:57:43.678159 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:43.678102 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" podStartSLOduration=1.678085683 podStartE2EDuration="1.678085683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:57:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:57:43.676136075 +0000 UTC m=+2283.759429348" watchObservedRunningTime="2026-07-06 14:57:43.678085683 +0000 UTC m=+2283.761378955" Jul 06 14:57:44.413644 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:44.413614 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3145282b-f355-454b-bd94-f66b359c726e" path="/var/lib/kubelet/pods/3145282b-f355-454b-bd94-f66b359c726e/volumes" Jul 06 14:57:49.227180 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:49.227142 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:57:53.272799 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:53.272749 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:53.273304 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:53.272818 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:53.285206 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:53.285179 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:57:53.720668 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:57:53.720637 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:58:19.983760 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:58:19.983717 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:23.932932 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:58:23.932893 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:58:26.819872 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:58:26.819837 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:26.919931 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:58:26.919891 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:41.512640 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:58:41.512601 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:58:57.029449 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:58:57.029411 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx"] Jul 06 14:58:57.079316 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:58:57.079283 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:57.922776 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:58:57.922732 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:01.013414 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:01.013368 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:59:08.247655 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.247616 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7"] Jul 06 14:59:08.251347 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.251318 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.254237 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.254202 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bb4316\"/\"rate-test-model-bb4316-kserve-self-signed-certs\"" Jul 06 14:59:08.269243 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.269205 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7"] Jul 06 14:59:08.288971 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.288924 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-model-cache\") pod \"rate-test-model-bb4316-kserve-658486d79f-xhtv7\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.289176 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.288978 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-tmp-dir\") pod \"rate-test-model-bb4316-kserve-658486d79f-xhtv7\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.289176 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.289035 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-home\") pod \"rate-test-model-bb4316-kserve-658486d79f-xhtv7\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.289176 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.289092 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6qlq\" (UniqueName: \"kubernetes.io/projected/834375b7-2662-48be-b452-2cc44e1affa1-kube-api-access-f6qlq\") pod \"rate-test-model-bb4316-kserve-658486d79f-xhtv7\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.289176 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.289115 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-dshm\") pod \"rate-test-model-bb4316-kserve-658486d79f-xhtv7\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.289373 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.289243 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/834375b7-2662-48be-b452-2cc44e1affa1-tls-certs\") pod \"rate-test-model-bb4316-kserve-658486d79f-xhtv7\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.301364 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.301315 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:08.390253 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.390207 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/834375b7-2662-48be-b452-2cc44e1affa1-tls-certs\") pod \"rate-test-model-bb4316-kserve-658486d79f-xhtv7\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.390476 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.390258 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-model-cache\") pod \"rate-test-model-bb4316-kserve-658486d79f-xhtv7\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.390476 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.390286 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-tmp-dir\") pod \"rate-test-model-bb4316-kserve-658486d79f-xhtv7\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.390476 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.390302 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-home\") pod \"rate-test-model-bb4316-kserve-658486d79f-xhtv7\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.390476 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.390331 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6qlq\" (UniqueName: \"kubernetes.io/projected/834375b7-2662-48be-b452-2cc44e1affa1-kube-api-access-f6qlq\") pod \"rate-test-model-bb4316-kserve-658486d79f-xhtv7\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.390476 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.390441 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-dshm\") pod \"rate-test-model-bb4316-kserve-658486d79f-xhtv7\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.390805 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.390785 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-home\") pod \"rate-test-model-bb4316-kserve-658486d79f-xhtv7\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.390862 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.390840 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-tmp-dir\") pod \"rate-test-model-bb4316-kserve-658486d79f-xhtv7\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.390862 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.390853 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-model-cache\") pod \"rate-test-model-bb4316-kserve-658486d79f-xhtv7\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.393252 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.393222 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-dshm\") pod \"rate-test-model-bb4316-kserve-658486d79f-xhtv7\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.393515 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.393496 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/834375b7-2662-48be-b452-2cc44e1affa1-tls-certs\") pod \"rate-test-model-bb4316-kserve-658486d79f-xhtv7\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.400929 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.400873 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6qlq\" (UniqueName: \"kubernetes.io/projected/834375b7-2662-48be-b452-2cc44e1affa1-kube-api-access-f6qlq\") pod \"rate-test-model-bb4316-kserve-658486d79f-xhtv7\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.563040 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.562996 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:08.721375 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:08.721347 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7"] Jul 06 14:59:08.723179 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:59:08.723142 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod834375b7_2662_48be_b452_2cc44e1affa1.slice/crio-b9fbecc9007ea69b109197bbf4c589174496fa84db3503dee6195ada9c7fa8b4 WatchSource:0}: Error finding container b9fbecc9007ea69b109197bbf4c589174496fa84db3503dee6195ada9c7fa8b4: Status 404 returned error can't find the container with id b9fbecc9007ea69b109197bbf4c589174496fa84db3503dee6195ada9c7fa8b4 Jul 06 14:59:09.092873 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:09.092835 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" event={"ID":"834375b7-2662-48be-b452-2cc44e1affa1","Type":"ContainerStarted","Data":"3a68f2717d3d6beaa07c1dd3abfca4f81f2ba4497fc1e09ca38ce45d6bc8e550"} Jul 06 14:59:09.093077 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:09.092882 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" event={"ID":"834375b7-2662-48be-b452-2cc44e1affa1","Type":"ContainerStarted","Data":"b9fbecc9007ea69b109197bbf4c589174496fa84db3503dee6195ada9c7fa8b4"} Jul 06 14:59:09.114156 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:09.114094 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" podStartSLOduration=1.1140754880000001 podStartE2EDuration="1.114075488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:59:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:59:09.113152458 +0000 UTC m=+2369.196445733" watchObservedRunningTime="2026-07-06 14:59:09.114075488 +0000 UTC m=+2369.197368808" Jul 06 14:59:12.051137 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.051070 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" podUID="28777f32-2d59-484f-868b-d6774637578e" containerName="main" containerID="cri-o://bed065b15ca4ed8e79cfa150ab4ec1cc5f4ba55924e8063e698d8ba4d789b17c" gracePeriod=45 Jul 06 14:59:12.320451 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.320418 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:59:12.426083 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.426044 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-dshm\") pod \"28777f32-2d59-484f-868b-d6774637578e\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " Jul 06 14:59:12.426275 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.426112 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-model-cache\") pod \"28777f32-2d59-484f-868b-d6774637578e\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " Jul 06 14:59:12.426275 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.426195 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpz4n\" (UniqueName: \"kubernetes.io/projected/28777f32-2d59-484f-868b-d6774637578e-kube-api-access-wpz4n\") pod \"28777f32-2d59-484f-868b-d6774637578e\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " Jul 06 14:59:12.426275 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.426222 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-tmp-dir\") pod \"28777f32-2d59-484f-868b-d6774637578e\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " Jul 06 14:59:12.426275 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.426264 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-home\") pod \"28777f32-2d59-484f-868b-d6774637578e\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " Jul 06 14:59:12.426508 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.426294 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28777f32-2d59-484f-868b-d6774637578e-tls-certs\") pod \"28777f32-2d59-484f-868b-d6774637578e\" (UID: \"28777f32-2d59-484f-868b-d6774637578e\") " Jul 06 14:59:12.426508 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.426385 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-model-cache" (OuterVolumeSpecName: "model-cache") pod "28777f32-2d59-484f-868b-d6774637578e" (UID: "28777f32-2d59-484f-868b-d6774637578e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:59:12.426665 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.426510 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-home" (OuterVolumeSpecName: "home") pod "28777f32-2d59-484f-868b-d6774637578e" (UID: "28777f32-2d59-484f-868b-d6774637578e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:59:12.426665 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.426527 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "28777f32-2d59-484f-868b-d6774637578e" (UID: "28777f32-2d59-484f-868b-d6774637578e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:59:12.426797 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.426677 2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-tmp-dir\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:59:12.426797 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.426695 2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-home\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:59:12.426797 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.426704 2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-model-cache\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:59:12.428501 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.428469 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-dshm" (OuterVolumeSpecName: "dshm") pod "28777f32-2d59-484f-868b-d6774637578e" (UID: "28777f32-2d59-484f-868b-d6774637578e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:59:12.428678 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.428585 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28777f32-2d59-484f-868b-d6774637578e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "28777f32-2d59-484f-868b-d6774637578e" (UID: "28777f32-2d59-484f-868b-d6774637578e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:59:12.428678 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.428628 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28777f32-2d59-484f-868b-d6774637578e-kube-api-access-wpz4n" (OuterVolumeSpecName: "kube-api-access-wpz4n") pod "28777f32-2d59-484f-868b-d6774637578e" (UID: "28777f32-2d59-484f-868b-d6774637578e"). InnerVolumeSpecName "kube-api-access-wpz4n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:59:12.527169 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.527123 2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28777f32-2d59-484f-868b-d6774637578e-dshm\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:59:12.527169 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.527160 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpz4n\" (UniqueName: \"kubernetes.io/projected/28777f32-2d59-484f-868b-d6774637578e-kube-api-access-wpz4n\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:59:12.527169 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:12.527175 2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28777f32-2d59-484f-868b-d6774637578e-tls-certs\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 14:59:13.115411 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:13.115369 2582 generic.go:356] "Generic (PLEG): container finished" podID="28777f32-2d59-484f-868b-d6774637578e" containerID="bed065b15ca4ed8e79cfa150ab4ec1cc5f4ba55924e8063e698d8ba4d789b17c" exitCode=0 Jul 06 14:59:13.115860 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:13.115432 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" Jul 06 14:59:13.115860 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:13.115457 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" event={"ID":"28777f32-2d59-484f-868b-d6774637578e","Type":"ContainerDied","Data":"bed065b15ca4ed8e79cfa150ab4ec1cc5f4ba55924e8063e698d8ba4d789b17c"} Jul 06 14:59:13.115860 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:13.115503 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx" event={"ID":"28777f32-2d59-484f-868b-d6774637578e","Type":"ContainerDied","Data":"afce057abd69ea8f3c6cec336d0f299520906b2fe55c3e447193e2a6127fa9d1"} Jul 06 14:59:13.115860 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:13.115520 2582 scope.go:117] "RemoveContainer" containerID="bed065b15ca4ed8e79cfa150ab4ec1cc5f4ba55924e8063e698d8ba4d789b17c" Jul 06 14:59:13.129067 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:13.129045 2582 scope.go:117] "RemoveContainer" containerID="bed065b15ca4ed8e79cfa150ab4ec1cc5f4ba55924e8063e698d8ba4d789b17c" Jul 06 14:59:13.129448 ip-10-0-136-208 kubenswrapper[2582]: E0706 14:59:13.129425 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bed065b15ca4ed8e79cfa150ab4ec1cc5f4ba55924e8063e698d8ba4d789b17c\": container with ID starting with bed065b15ca4ed8e79cfa150ab4ec1cc5f4ba55924e8063e698d8ba4d789b17c not found: ID does not exist" containerID="bed065b15ca4ed8e79cfa150ab4ec1cc5f4ba55924e8063e698d8ba4d789b17c" Jul 06 14:59:13.129535 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:13.129464 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bed065b15ca4ed8e79cfa150ab4ec1cc5f4ba55924e8063e698d8ba4d789b17c"} err="failed to get container status \"bed065b15ca4ed8e79cfa150ab4ec1cc5f4ba55924e8063e698d8ba4d789b17c\": rpc error: code = NotFound desc = could not find container \"bed065b15ca4ed8e79cfa150ab4ec1cc5f4ba55924e8063e698d8ba4d789b17c\": container with ID starting with bed065b15ca4ed8e79cfa150ab4ec1cc5f4ba55924e8063e698d8ba4d789b17c not found: ID does not exist" Jul 06 14:59:13.141267 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:13.141234 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx"] Jul 06 14:59:13.148421 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:13.148392 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bb4316/sub-test-model-bb4316-kserve-7dfd77dfbc-2qlpx"] Jul 06 14:59:14.413404 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:14.413364 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28777f32-2d59-484f-868b-d6774637578e" path="/var/lib/kubelet/pods/28777f32-2d59-484f-868b-d6774637578e/volumes" Jul 06 14:59:14.712992 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:14.712879 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:59:17.558285 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:17.558248 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:17.660395 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:17.660351 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:18.563581 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:18.563519 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:18.564041 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:18.563606 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:18.576749 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:18.576720 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:19.162898 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:19.162862 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 14:59:34.143984 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.143950 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh"] Jul 06 14:59:34.144463 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.144275 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28777f32-2d59-484f-868b-d6774637578e" containerName="main" Jul 06 14:59:34.144463 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.144285 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="28777f32-2d59-484f-868b-d6774637578e" containerName="main" Jul 06 14:59:34.144463 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.144349 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="28777f32-2d59-484f-868b-d6774637578e" containerName="main" Jul 06 14:59:34.147161 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.147140 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.151324 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.151294 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-aa7c3f\"/\"rate-test-model-aa7c3f-kserve-self-signed-certs\"" Jul 06 14:59:34.151324 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.151309 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-aa7c3f\"/\"kube-root-ca.crt\"" Jul 06 14:59:34.151574 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.151301 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-aa7c3f\"/\"openshift-service-ca.crt\"" Jul 06 14:59:34.151574 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.151433 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-aa7c3f\"/\"default-dockercfg-zc9cx\"" Jul 06 14:59:34.157022 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.156992 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh"] Jul 06 14:59:34.172797 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.172766 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:34.228576 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.228533 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bef47097-e9a9-495e-a0bb-863a013ac0ee-tls-certs\") pod \"rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.228774 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.228595 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-model-cache\") pod \"rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.228774 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.228646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-tmp-dir\") pod \"rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.228774 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.228701 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg8p6\" (UniqueName: \"kubernetes.io/projected/bef47097-e9a9-495e-a0bb-863a013ac0ee-kube-api-access-vg8p6\") pod \"rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.228774 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.228723 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-dshm\") pod \"rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.228979 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.228848 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-home\") pod \"rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.330209 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.330166 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg8p6\" (UniqueName: \"kubernetes.io/projected/bef47097-e9a9-495e-a0bb-863a013ac0ee-kube-api-access-vg8p6\") pod \"rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.330209 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.330209 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-dshm\") pod \"rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.330486 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.330246 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-home\") pod \"rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.330486 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.330297 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bef47097-e9a9-495e-a0bb-863a013ac0ee-tls-certs\") pod \"rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.330486 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.330321 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-model-cache\") pod \"rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.330486 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.330387 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-tmp-dir\") pod \"rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.330777 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.330726 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-home\") pod \"rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.330824 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.330800 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-tmp-dir\") pod \"rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.330866 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.330825 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-model-cache\") pod \"rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.332847 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.332819 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-dshm\") pod \"rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.333043 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.333025 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bef47097-e9a9-495e-a0bb-863a013ac0ee-tls-certs\") pod \"rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.340124 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.340084 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg8p6\" (UniqueName: \"kubernetes.io/projected/bef47097-e9a9-495e-a0bb-863a013ac0ee-kube-api-access-vg8p6\") pod \"rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.458260 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.458149 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:34.610757 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:34.610721 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh"] Jul 06 14:59:34.613029 ip-10-0-136-208 kubenswrapper[2582]: W0706 14:59:34.612999 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbef47097_e9a9_495e_a0bb_863a013ac0ee.slice/crio-bbc18aad42f4d1561498612cb75145282f19d5d198d3a41170224545300ee25c WatchSource:0}: Error finding container bbc18aad42f4d1561498612cb75145282f19d5d198d3a41170224545300ee25c: Status 404 returned error can't find the container with id bbc18aad42f4d1561498612cb75145282f19d5d198d3a41170224545300ee25c Jul 06 14:59:35.240339 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:35.240288 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" event={"ID":"bef47097-e9a9-495e-a0bb-863a013ac0ee","Type":"ContainerStarted","Data":"8f9de52bec742b5c7bdec803836219983c6ddd1a27b1ae568c1fe92a2db16a26"} Jul 06 14:59:35.240339 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:35.240341 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" event={"ID":"bef47097-e9a9-495e-a0bb-863a013ac0ee","Type":"ContainerStarted","Data":"bbc18aad42f4d1561498612cb75145282f19d5d198d3a41170224545300ee25c"} Jul 06 14:59:35.262629 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:35.262563 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" podStartSLOduration=1.262534906 podStartE2EDuration="1.262534906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:59:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:59:35.260275134 +0000 UTC m=+2395.343568409" watchObservedRunningTime="2026-07-06 14:59:35.262534906 +0000 UTC m=+2395.345828180" Jul 06 14:59:38.520344 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:38.520287 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:59:44.459025 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:44.458983 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:44.459623 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:44.459044 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:44.472004 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:44.471977 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:45.308948 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:45.308914 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 14:59:55.425397 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:55.425346 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 14:59:58.641151 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:58.641118 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:58.741783 ip-10-0-136-208 kubenswrapper[2582]: I0706 14:59:58.741748 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:06.837759 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:06.837726 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:06.938011 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:06.937971 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:15.299011 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:15.298976 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:16.118061 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:16.118023 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 15:00:23.496951 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:23.496916 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7"] Jul 06 15:00:23.539995 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:23.539961 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:24.358945 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:24.358909 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh"] Jul 06 15:00:24.379950 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:24.379918 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:25.460706 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:25.460673 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:25.825991 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:25.825953 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:25.925062 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:25.925024 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:26.026678 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:26.026647 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:26.109827 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:26.109737 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:30.015580 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:30.015526 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 15:00:30.887380 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:30.887346 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:38.518104 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:38.518030 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" podUID="834375b7-2662-48be-b452-2cc44e1affa1" containerName="main" containerID="cri-o://3a68f2717d3d6beaa07c1dd3abfca4f81f2ba4497fc1e09ca38ce45d6bc8e550" gracePeriod=45 Jul 06 15:00:38.776055 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:38.775983 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 15:00:38.923362 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:38.923311 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-model-cache\") pod \"834375b7-2662-48be-b452-2cc44e1affa1\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " Jul 06 15:00:38.923592 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:38.923390 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-dshm\") pod \"834375b7-2662-48be-b452-2cc44e1affa1\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " Jul 06 15:00:38.923592 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:38.923437 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6qlq\" (UniqueName: \"kubernetes.io/projected/834375b7-2662-48be-b452-2cc44e1affa1-kube-api-access-f6qlq\") pod \"834375b7-2662-48be-b452-2cc44e1affa1\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " Jul 06 15:00:38.923592 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:38.923480 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-home\") pod \"834375b7-2662-48be-b452-2cc44e1affa1\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " Jul 06 15:00:38.923592 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:38.923512 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/834375b7-2662-48be-b452-2cc44e1affa1-tls-certs\") pod \"834375b7-2662-48be-b452-2cc44e1affa1\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " Jul 06 15:00:38.923871 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:38.923609 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-tmp-dir\") pod \"834375b7-2662-48be-b452-2cc44e1affa1\" (UID: \"834375b7-2662-48be-b452-2cc44e1affa1\") " Jul 06 15:00:38.923871 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:38.923650 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-model-cache" (OuterVolumeSpecName: "model-cache") pod "834375b7-2662-48be-b452-2cc44e1affa1" (UID: "834375b7-2662-48be-b452-2cc44e1affa1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:00:38.923871 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:38.923802 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-home" (OuterVolumeSpecName: "home") pod "834375b7-2662-48be-b452-2cc44e1affa1" (UID: "834375b7-2662-48be-b452-2cc44e1affa1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:00:38.924051 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:38.923882 2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-model-cache\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 15:00:38.924051 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:38.923898 2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-home\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 15:00:38.924051 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:38.923947 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "834375b7-2662-48be-b452-2cc44e1affa1" (UID: "834375b7-2662-48be-b452-2cc44e1affa1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:00:38.925724 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:38.925702 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-dshm" (OuterVolumeSpecName: "dshm") pod "834375b7-2662-48be-b452-2cc44e1affa1" (UID: "834375b7-2662-48be-b452-2cc44e1affa1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:00:38.925794 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:38.925770 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/834375b7-2662-48be-b452-2cc44e1affa1-kube-api-access-f6qlq" (OuterVolumeSpecName: "kube-api-access-f6qlq") pod "834375b7-2662-48be-b452-2cc44e1affa1" (UID: "834375b7-2662-48be-b452-2cc44e1affa1"). InnerVolumeSpecName "kube-api-access-f6qlq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:00:38.925905 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:38.925884 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/834375b7-2662-48be-b452-2cc44e1affa1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "834375b7-2662-48be-b452-2cc44e1affa1" (UID: "834375b7-2662-48be-b452-2cc44e1affa1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:00:39.024968 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.024929 2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-tmp-dir\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 15:00:39.024968 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.024960 2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/834375b7-2662-48be-b452-2cc44e1affa1-dshm\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 15:00:39.024968 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.024972 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6qlq\" (UniqueName: \"kubernetes.io/projected/834375b7-2662-48be-b452-2cc44e1affa1-kube-api-access-f6qlq\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 15:00:39.024968 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.024982 2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/834375b7-2662-48be-b452-2cc44e1affa1-tls-certs\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 15:00:39.380440 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.380384 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" podUID="bef47097-e9a9-495e-a0bb-863a013ac0ee" containerName="main" containerID="cri-o://8f9de52bec742b5c7bdec803836219983c6ddd1a27b1ae568c1fe92a2db16a26" gracePeriod=45 Jul 06 15:00:39.585514 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.585480 2582 generic.go:356] "Generic (PLEG): container finished" podID="834375b7-2662-48be-b452-2cc44e1affa1" containerID="3a68f2717d3d6beaa07c1dd3abfca4f81f2ba4497fc1e09ca38ce45d6bc8e550" exitCode=0 Jul 06 15:00:39.586001 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.585526 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" Jul 06 15:00:39.586001 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.585575 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" event={"ID":"834375b7-2662-48be-b452-2cc44e1affa1","Type":"ContainerDied","Data":"3a68f2717d3d6beaa07c1dd3abfca4f81f2ba4497fc1e09ca38ce45d6bc8e550"} Jul 06 15:00:39.586001 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.585617 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7" event={"ID":"834375b7-2662-48be-b452-2cc44e1affa1","Type":"ContainerDied","Data":"b9fbecc9007ea69b109197bbf4c589174496fa84db3503dee6195ada9c7fa8b4"} Jul 06 15:00:39.586001 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.585647 2582 scope.go:117] "RemoveContainer" containerID="3a68f2717d3d6beaa07c1dd3abfca4f81f2ba4497fc1e09ca38ce45d6bc8e550" Jul 06 15:00:39.588188 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.588159 2582 generic.go:356] "Generic (PLEG): container finished" podID="bef47097-e9a9-495e-a0bb-863a013ac0ee" containerID="8f9de52bec742b5c7bdec803836219983c6ddd1a27b1ae568c1fe92a2db16a26" exitCode=0 Jul 06 15:00:39.588290 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.588226 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" event={"ID":"bef47097-e9a9-495e-a0bb-863a013ac0ee","Type":"ContainerDied","Data":"8f9de52bec742b5c7bdec803836219983c6ddd1a27b1ae568c1fe92a2db16a26"} Jul 06 15:00:39.595540 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.595515 2582 scope.go:117] "RemoveContainer" containerID="3a68f2717d3d6beaa07c1dd3abfca4f81f2ba4497fc1e09ca38ce45d6bc8e550" Jul 06 15:00:39.595907 ip-10-0-136-208 kubenswrapper[2582]: E0706 15:00:39.595887 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a68f2717d3d6beaa07c1dd3abfca4f81f2ba4497fc1e09ca38ce45d6bc8e550\": container with ID starting with 3a68f2717d3d6beaa07c1dd3abfca4f81f2ba4497fc1e09ca38ce45d6bc8e550 not found: ID does not exist" containerID="3a68f2717d3d6beaa07c1dd3abfca4f81f2ba4497fc1e09ca38ce45d6bc8e550" Jul 06 15:00:39.596010 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.595919 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a68f2717d3d6beaa07c1dd3abfca4f81f2ba4497fc1e09ca38ce45d6bc8e550"} err="failed to get container status \"3a68f2717d3d6beaa07c1dd3abfca4f81f2ba4497fc1e09ca38ce45d6bc8e550\": rpc error: code = NotFound desc = could not find container \"3a68f2717d3d6beaa07c1dd3abfca4f81f2ba4497fc1e09ca38ce45d6bc8e550\": container with ID starting with 3a68f2717d3d6beaa07c1dd3abfca4f81f2ba4497fc1e09ca38ce45d6bc8e550 not found: ID does not exist" Jul 06 15:00:39.610903 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.610863 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7"] Jul 06 15:00:39.616480 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.616447 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bb4316/rate-test-model-bb4316-kserve-658486d79f-xhtv7"] Jul 06 15:00:39.650563 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.650522 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 15:00:39.831998 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.831959 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vg8p6\" (UniqueName: \"kubernetes.io/projected/bef47097-e9a9-495e-a0bb-863a013ac0ee-kube-api-access-vg8p6\") pod \"bef47097-e9a9-495e-a0bb-863a013ac0ee\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " Jul 06 15:00:39.832185 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.832010 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bef47097-e9a9-495e-a0bb-863a013ac0ee-tls-certs\") pod \"bef47097-e9a9-495e-a0bb-863a013ac0ee\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " Jul 06 15:00:39.832185 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.832048 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-model-cache\") pod \"bef47097-e9a9-495e-a0bb-863a013ac0ee\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " Jul 06 15:00:39.832185 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.832143 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-dshm\") pod \"bef47097-e9a9-495e-a0bb-863a013ac0ee\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " Jul 06 15:00:39.832311 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.832255 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-home\") pod \"bef47097-e9a9-495e-a0bb-863a013ac0ee\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " Jul 06 15:00:39.832311 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.832292 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-model-cache" (OuterVolumeSpecName: "model-cache") pod "bef47097-e9a9-495e-a0bb-863a013ac0ee" (UID: "bef47097-e9a9-495e-a0bb-863a013ac0ee"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:00:39.832408 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.832298 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-tmp-dir\") pod \"bef47097-e9a9-495e-a0bb-863a013ac0ee\" (UID: \"bef47097-e9a9-495e-a0bb-863a013ac0ee\") " Jul 06 15:00:39.832514 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.832492 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-home" (OuterVolumeSpecName: "home") pod "bef47097-e9a9-495e-a0bb-863a013ac0ee" (UID: "bef47097-e9a9-495e-a0bb-863a013ac0ee"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:00:39.832604 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.832507 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bef47097-e9a9-495e-a0bb-863a013ac0ee" (UID: "bef47097-e9a9-495e-a0bb-863a013ac0ee"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:00:39.832727 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.832684 2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-model-cache\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 15:00:39.832727 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.832710 2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-home\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 15:00:39.832979 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.832798 2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-tmp-dir\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 15:00:39.834500 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.834469 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-dshm" (OuterVolumeSpecName: "dshm") pod "bef47097-e9a9-495e-a0bb-863a013ac0ee" (UID: "bef47097-e9a9-495e-a0bb-863a013ac0ee"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:00:39.834660 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.834528 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bef47097-e9a9-495e-a0bb-863a013ac0ee-kube-api-access-vg8p6" (OuterVolumeSpecName: "kube-api-access-vg8p6") pod "bef47097-e9a9-495e-a0bb-863a013ac0ee" (UID: "bef47097-e9a9-495e-a0bb-863a013ac0ee"). InnerVolumeSpecName "kube-api-access-vg8p6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:00:39.834660 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.834535 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bef47097-e9a9-495e-a0bb-863a013ac0ee-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bef47097-e9a9-495e-a0bb-863a013ac0ee" (UID: "bef47097-e9a9-495e-a0bb-863a013ac0ee"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:00:39.933351 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.933255 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vg8p6\" (UniqueName: \"kubernetes.io/projected/bef47097-e9a9-495e-a0bb-863a013ac0ee-kube-api-access-vg8p6\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 15:00:39.933351 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.933292 2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bef47097-e9a9-495e-a0bb-863a013ac0ee-tls-certs\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 15:00:39.933351 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:39.933302 2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bef47097-e9a9-495e-a0bb-863a013ac0ee-dshm\") on node \"ip-10-0-136-208.ec2.internal\" DevicePath \"\"" Jul 06 15:00:40.414285 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:40.414246 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="834375b7-2662-48be-b452-2cc44e1affa1" path="/var/lib/kubelet/pods/834375b7-2662-48be-b452-2cc44e1affa1/volumes" Jul 06 15:00:40.595641 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:40.595617 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" Jul 06 15:00:40.595641 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:40.595620 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh" event={"ID":"bef47097-e9a9-495e-a0bb-863a013ac0ee","Type":"ContainerDied","Data":"bbc18aad42f4d1561498612cb75145282f19d5d198d3a41170224545300ee25c"} Jul 06 15:00:40.596154 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:40.595672 2582 scope.go:117] "RemoveContainer" containerID="8f9de52bec742b5c7bdec803836219983c6ddd1a27b1ae568c1fe92a2db16a26" Jul 06 15:00:40.614043 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:40.614008 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh"] Jul 06 15:00:40.617423 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:40.617394 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-aa7c3f/rate-test-model-aa7c3f-kserve-848459d5b7-lmtrh"] Jul 06 15:00:42.413205 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:00:42.413173 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bef47097-e9a9-495e-a0bb-863a013ac0ee" path="/var/lib/kubelet/pods/bef47097-e9a9-495e-a0bb-863a013ac0ee/volumes" Jul 06 15:01:08.315058 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:08.315026 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:11.613473 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:11.613435 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dg5sb"] Jul 06 15:01:12.128703 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:12.128663 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:15.677682 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:15.677642 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:15.746042 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:15.746011 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:15.956825 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:15.956722 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:16.228740 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:16.228653 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:22.679796 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:22.679756 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v_baa3e291-464d-47ce-bb15-b0cfd33e926f/manager/0.log" Jul 06 15:01:22.687230 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:22.687203 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v_baa3e291-464d-47ce-bb15-b0cfd33e926f/copy-manifests/0.log" Jul 06 15:01:23.571995 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:23.571963 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp_a5942e6c-f3d1-4ceb-ac3f-b5b556547c42/util/0.log" Jul 06 15:01:23.578599 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:23.578579 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp_a5942e6c-f3d1-4ceb-ac3f-b5b556547c42/pull/0.log" Jul 06 15:01:23.585501 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:23.585475 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp_a5942e6c-f3d1-4ceb-ac3f-b5b556547c42/extract/0.log" Jul 06 15:01:23.695652 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:23.695627 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v_c16f9ac0-3f2e-490d-a446-927d7e6eee88/util/0.log" Jul 06 15:01:23.702435 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:23.702408 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v_c16f9ac0-3f2e-490d-a446-927d7e6eee88/pull/0.log" Jul 06 15:01:23.709281 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:23.709262 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v_c16f9ac0-3f2e-490d-a446-927d7e6eee88/extract/0.log" Jul 06 15:01:23.818900 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:23.818864 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q_d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0/pull/0.log" Jul 06 15:01:23.825669 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:23.825602 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q_d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0/extract/0.log" Jul 06 15:01:23.831739 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:23.831723 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q_d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0/util/0.log" Jul 06 15:01:23.941710 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:23.941681 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7_2cac4035-bb0c-4007-bc7d-e4b64d3f860b/util/0.log" Jul 06 15:01:23.948861 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:23.948831 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7_2cac4035-bb0c-4007-bc7d-e4b64d3f860b/pull/0.log" Jul 06 15:01:23.955509 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:23.955478 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7_2cac4035-bb0c-4007-bc7d-e4b64d3f860b/extract/0.log" Jul 06 15:01:24.197290 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:24.197208 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-qm7qh_db41a88c-9883-4c29-b5db-f06a9ee5920d/manager/0.log" Jul 06 15:01:24.545311 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:24.545278 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7zqj5_7f349558-a43c-43b8-8b18-87e23af44a47/registry-server/0.log" Jul 06 15:01:24.671011 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:24.670981 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-m77cl_a2dfcf31-6063-499e-a84f-da4bcf0e6a57/manager/0.log" Jul 06 15:01:24.803857 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:24.803773 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dg5sb_d529667d-8e38-4e94-8502-a556f288ca60/limitador/0.log" Jul 06 15:01:25.287443 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:25.287416 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4287d8_fb364d0c-b79d-45e1-8d73-6e1e3c723059/istio-proxy/0.log" Jul 06 15:01:26.123217 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:26.123187 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d778f859f-t8gjz_0d6d9866-81db-423a-b0ff-75a455a72619/router/0.log" Jul 06 15:01:26.944598 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:26.944566 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-swlhl_0fd494d1-9789-4e9f-92d0-77fd7cb5048f/main/0.log" Jul 06 15:01:27.060540 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:27.060509 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-n8tlx_8e280060-2c0b-4f31-9370-ca293786dc75/main/0.log" Jul 06 15:01:31.374120 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.374082 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-25f49/must-gather-r77mj"] Jul 06 15:01:31.374591 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.374393 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="834375b7-2662-48be-b452-2cc44e1affa1" containerName="main" Jul 06 15:01:31.374591 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.374404 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="834375b7-2662-48be-b452-2cc44e1affa1" containerName="main" Jul 06 15:01:31.374591 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.374425 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bef47097-e9a9-495e-a0bb-863a013ac0ee" containerName="main" Jul 06 15:01:31.374591 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.374431 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bef47097-e9a9-495e-a0bb-863a013ac0ee" containerName="main" Jul 06 15:01:31.374591 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.374486 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bef47097-e9a9-495e-a0bb-863a013ac0ee" containerName="main" Jul 06 15:01:31.374591 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.374495 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="834375b7-2662-48be-b452-2cc44e1affa1" containerName="main" Jul 06 15:01:31.377580 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.377535 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-25f49/must-gather-r77mj" Jul 06 15:01:31.380663 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.380637 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-25f49\"/\"kube-root-ca.crt\"" Jul 06 15:01:31.380663 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.380653 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-25f49\"/\"openshift-service-ca.crt\"" Jul 06 15:01:31.380862 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.380711 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-25f49\"/\"default-dockercfg-c76v2\"" Jul 06 15:01:31.381418 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.381389 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:31.392491 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.392465 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-25f49/must-gather-r77mj"] Jul 06 15:01:31.491307 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.491261 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpj7m\" (UniqueName: \"kubernetes.io/projected/30ae82eb-b47b-46d2-b02a-3674058225bf-kube-api-access-qpj7m\") pod \"must-gather-r77mj\" (UID: \"30ae82eb-b47b-46d2-b02a-3674058225bf\") " pod="openshift-must-gather-25f49/must-gather-r77mj" Jul 06 15:01:31.491504 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.491336 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/30ae82eb-b47b-46d2-b02a-3674058225bf-must-gather-output\") pod \"must-gather-r77mj\" (UID: \"30ae82eb-b47b-46d2-b02a-3674058225bf\") " pod="openshift-must-gather-25f49/must-gather-r77mj" Jul 06 15:01:31.596987 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.592345 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/30ae82eb-b47b-46d2-b02a-3674058225bf-must-gather-output\") pod \"must-gather-r77mj\" (UID: \"30ae82eb-b47b-46d2-b02a-3674058225bf\") " pod="openshift-must-gather-25f49/must-gather-r77mj" Jul 06 15:01:31.596987 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.592472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpj7m\" (UniqueName: \"kubernetes.io/projected/30ae82eb-b47b-46d2-b02a-3674058225bf-kube-api-access-qpj7m\") pod \"must-gather-r77mj\" (UID: \"30ae82eb-b47b-46d2-b02a-3674058225bf\") " pod="openshift-must-gather-25f49/must-gather-r77mj" Jul 06 15:01:31.596987 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.593208 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/30ae82eb-b47b-46d2-b02a-3674058225bf-must-gather-output\") pod \"must-gather-r77mj\" (UID: \"30ae82eb-b47b-46d2-b02a-3674058225bf\") " pod="openshift-must-gather-25f49/must-gather-r77mj" Jul 06 15:01:31.598497 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.598469 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:31.602446 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.602422 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpj7m\" (UniqueName: \"kubernetes.io/projected/30ae82eb-b47b-46d2-b02a-3674058225bf-kube-api-access-qpj7m\") pod \"must-gather-r77mj\" (UID: \"30ae82eb-b47b-46d2-b02a-3674058225bf\") " pod="openshift-must-gather-25f49/must-gather-r77mj" Jul 06 15:01:31.686621 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.686507 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-25f49/must-gather-r77mj" Jul 06 15:01:31.836078 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.835977 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-25f49/must-gather-r77mj"] Jul 06 15:01:31.838834 ip-10-0-136-208 kubenswrapper[2582]: W0706 15:01:31.838804 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30ae82eb_b47b_46d2_b02a_3674058225bf.slice/crio-2dd72cda6499a648996518423310405b51766260776cb19cbc33e02d9f90d648 WatchSource:0}: Error finding container 2dd72cda6499a648996518423310405b51766260776cb19cbc33e02d9f90d648: Status 404 returned error can't find the container with id 2dd72cda6499a648996518423310405b51766260776cb19cbc33e02d9f90d648 Jul 06 15:01:31.840797 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.840781 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 15:01:31.858084 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:31.858047 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-25f49/must-gather-r77mj" event={"ID":"30ae82eb-b47b-46d2-b02a-3674058225bf","Type":"ContainerStarted","Data":"2dd72cda6499a648996518423310405b51766260776cb19cbc33e02d9f90d648"} Jul 06 15:01:33.871133 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:33.871097 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-25f49/must-gather-r77mj" event={"ID":"30ae82eb-b47b-46d2-b02a-3674058225bf","Type":"ContainerStarted","Data":"2b82e4a5c0e27b236b7a87c3c2cdff0cf2cb9576f21474c0e6a3cc3818b7d55f"} Jul 06 15:01:33.871654 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:33.871145 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-25f49/must-gather-r77mj" event={"ID":"30ae82eb-b47b-46d2-b02a-3674058225bf","Type":"ContainerStarted","Data":"4edf98ab229b8e49ddb5e4ca5ec49f0225b21cd49e0842d5cd31bd581a77fd39"} Jul 06 15:01:33.900652 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:33.900594 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-25f49/must-gather-r77mj" podStartSLOduration=1.740616312 podStartE2EDuration="2.900576387s" totalImagesPullingTime="1.159960075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:01:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:01:33.897894874 +0000 UTC m=+2513.981188149" watchObservedRunningTime="2026-07-06 15:01:33.900576387 +0000 UTC m=+2513.983869653" Jul 06 15:01:34.754682 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:34.754653 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-78ldj_5e1320b0-0f60-4ac3-9519-44b66306b3b1/global-pull-secret-syncer/0.log" Jul 06 15:01:34.867827 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:34.867789 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4gp2l_0cb4fe3b-b20c-4913-8bb3-743295030fa8/konnectivity-agent/0.log" Jul 06 15:01:35.060049 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:35.060016 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-208.ec2.internal_b8c6cec3a193d1bdd174e8ced89210cc/haproxy/0.log" Jul 06 15:01:39.785945 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:39.785917 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp_a5942e6c-f3d1-4ceb-ac3f-b5b556547c42/extract/0.log" Jul 06 15:01:39.814057 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:39.813974 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp_a5942e6c-f3d1-4ceb-ac3f-b5b556547c42/util/0.log" Jul 06 15:01:39.843182 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:39.843148 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bqprp_a5942e6c-f3d1-4ceb-ac3f-b5b556547c42/pull/0.log" Jul 06 15:01:39.878175 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:39.878145 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v_c16f9ac0-3f2e-490d-a446-927d7e6eee88/extract/0.log" Jul 06 15:01:39.905993 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:39.905963 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v_c16f9ac0-3f2e-490d-a446-927d7e6eee88/util/0.log" Jul 06 15:01:39.929976 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:39.929923 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0q8s2v_c16f9ac0-3f2e-490d-a446-927d7e6eee88/pull/0.log" Jul 06 15:01:39.990531 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:39.990494 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q_d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0/extract/0.log" Jul 06 15:01:40.013291 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:40.013251 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q_d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0/util/0.log" Jul 06 15:01:40.039485 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:40.039388 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tdg7q_d7b96ad2-08ef-4d2a-bb11-a3f904e91bf0/pull/0.log" Jul 06 15:01:40.073184 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:40.073158 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7_2cac4035-bb0c-4007-bc7d-e4b64d3f860b/extract/0.log" Jul 06 15:01:40.103315 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:40.103245 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7_2cac4035-bb0c-4007-bc7d-e4b64d3f860b/util/0.log" Jul 06 15:01:40.134627 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:40.134600 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zzzv7_2cac4035-bb0c-4007-bc7d-e4b64d3f860b/pull/0.log" Jul 06 15:01:40.689928 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:40.689894 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-qm7qh_db41a88c-9883-4c29-b5db-f06a9ee5920d/manager/0.log" Jul 06 15:01:40.813915 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:40.813882 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7zqj5_7f349558-a43c-43b8-8b18-87e23af44a47/registry-server/0.log" Jul 06 15:01:40.971476 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:40.971391 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-m77cl_a2dfcf31-6063-499e-a84f-da4bcf0e6a57/manager/0.log" Jul 06 15:01:40.997987 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:40.997960 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dg5sb_d529667d-8e38-4e94-8502-a556f288ca60/limitador/0.log" Jul 06 15:01:43.172001 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:43.171962 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-4ddqc_f132d7c3-f91f-45c9-ae32-c98809a6efd5/cluster-monitoring-operator/0.log" Jul 06 15:01:43.466487 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:43.466191 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ddfxn_2d6d3115-6b26-4ba3-aaf9-51b92a24d434/node-exporter/0.log" Jul 06 15:01:43.505251 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:43.505180 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ddfxn_2d6d3115-6b26-4ba3-aaf9-51b92a24d434/kube-rbac-proxy/0.log" Jul 06 15:01:43.561311 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:43.561260 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ddfxn_2d6d3115-6b26-4ba3-aaf9-51b92a24d434/init-textfile/0.log" Jul 06 15:01:45.752044 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:45.751995 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs"] Jul 06 15:01:45.761251 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:45.761216 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:45.770170 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:45.770117 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs"] Jul 06 15:01:45.845250 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:45.845205 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k56bk\" (UniqueName: \"kubernetes.io/projected/37bada09-4950-4cb9-8b8f-cf437a94d8b3-kube-api-access-k56bk\") pod \"perf-node-gather-daemonset-9jmjs\" (UID: \"37bada09-4950-4cb9-8b8f-cf437a94d8b3\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:45.845481 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:45.845340 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37bada09-4950-4cb9-8b8f-cf437a94d8b3-podres\") pod \"perf-node-gather-daemonset-9jmjs\" (UID: \"37bada09-4950-4cb9-8b8f-cf437a94d8b3\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:45.845481 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:45.845407 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37bada09-4950-4cb9-8b8f-cf437a94d8b3-lib-modules\") pod \"perf-node-gather-daemonset-9jmjs\" (UID: \"37bada09-4950-4cb9-8b8f-cf437a94d8b3\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:45.845624 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:45.845486 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37bada09-4950-4cb9-8b8f-cf437a94d8b3-proc\") pod \"perf-node-gather-daemonset-9jmjs\" (UID: \"37bada09-4950-4cb9-8b8f-cf437a94d8b3\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:45.845624 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:45.845517 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37bada09-4950-4cb9-8b8f-cf437a94d8b3-sys\") pod \"perf-node-gather-daemonset-9jmjs\" (UID: \"37bada09-4950-4cb9-8b8f-cf437a94d8b3\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:45.946388 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:45.946317 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37bada09-4950-4cb9-8b8f-cf437a94d8b3-lib-modules\") pod \"perf-node-gather-daemonset-9jmjs\" (UID: \"37bada09-4950-4cb9-8b8f-cf437a94d8b3\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:45.946631 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:45.946439 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37bada09-4950-4cb9-8b8f-cf437a94d8b3-proc\") pod \"perf-node-gather-daemonset-9jmjs\" (UID: \"37bada09-4950-4cb9-8b8f-cf437a94d8b3\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:45.946631 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:45.946475 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37bada09-4950-4cb9-8b8f-cf437a94d8b3-sys\") pod \"perf-node-gather-daemonset-9jmjs\" (UID: \"37bada09-4950-4cb9-8b8f-cf437a94d8b3\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:45.946631 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:45.946539 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k56bk\" (UniqueName: \"kubernetes.io/projected/37bada09-4950-4cb9-8b8f-cf437a94d8b3-kube-api-access-k56bk\") pod \"perf-node-gather-daemonset-9jmjs\" (UID: \"37bada09-4950-4cb9-8b8f-cf437a94d8b3\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:45.946631 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:45.946571 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37bada09-4950-4cb9-8b8f-cf437a94d8b3-lib-modules\") pod \"perf-node-gather-daemonset-9jmjs\" (UID: \"37bada09-4950-4cb9-8b8f-cf437a94d8b3\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:45.946631 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:45.946612 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37bada09-4950-4cb9-8b8f-cf437a94d8b3-sys\") pod \"perf-node-gather-daemonset-9jmjs\" (UID: \"37bada09-4950-4cb9-8b8f-cf437a94d8b3\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:45.946928 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:45.946627 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37bada09-4950-4cb9-8b8f-cf437a94d8b3-proc\") pod \"perf-node-gather-daemonset-9jmjs\" (UID: \"37bada09-4950-4cb9-8b8f-cf437a94d8b3\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:45.946928 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:45.946691 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37bada09-4950-4cb9-8b8f-cf437a94d8b3-podres\") pod \"perf-node-gather-daemonset-9jmjs\" (UID: \"37bada09-4950-4cb9-8b8f-cf437a94d8b3\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:45.946928 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:45.946876 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37bada09-4950-4cb9-8b8f-cf437a94d8b3-podres\") pod \"perf-node-gather-daemonset-9jmjs\" (UID: \"37bada09-4950-4cb9-8b8f-cf437a94d8b3\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:45.957591 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:45.957510 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k56bk\" (UniqueName: \"kubernetes.io/projected/37bada09-4950-4cb9-8b8f-cf437a94d8b3-kube-api-access-k56bk\") pod \"perf-node-gather-daemonset-9jmjs\" (UID: \"37bada09-4950-4cb9-8b8f-cf437a94d8b3\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:46.081815 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:46.081764 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:46.286354 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:46.286320 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs"] Jul 06 15:01:46.288482 ip-10-0-136-208 kubenswrapper[2582]: W0706 15:01:46.288446 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod37bada09_4950_4cb9_8b8f_cf437a94d8b3.slice/crio-94acc3b88a46aab63e54b1f613cd055a34443c2cf189eed8605fb0ac60d38571 WatchSource:0}: Error finding container 94acc3b88a46aab63e54b1f613cd055a34443c2cf189eed8605fb0ac60d38571: Status 404 returned error can't find the container with id 94acc3b88a46aab63e54b1f613cd055a34443c2cf189eed8605fb0ac60d38571 Jul 06 15:01:46.976952 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:46.976819 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" event={"ID":"37bada09-4950-4cb9-8b8f-cf437a94d8b3","Type":"ContainerStarted","Data":"98fa4dd41c687c27c0aed31e188bd18e2532e5c504fda0e9834cd3df4f904821"} Jul 06 15:01:46.976952 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:46.976900 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" event={"ID":"37bada09-4950-4cb9-8b8f-cf437a94d8b3","Type":"ContainerStarted","Data":"94acc3b88a46aab63e54b1f613cd055a34443c2cf189eed8605fb0ac60d38571"} Jul 06 15:01:46.977686 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:46.977613 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:46.999079 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:46.998977 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" podStartSLOduration=1.998944291 podStartE2EDuration="1.998944291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:01:46.995246631 +0000 UTC m=+2527.078539905" watchObservedRunningTime="2026-07-06 15:01:46.998944291 +0000 UTC m=+2527.082237566" Jul 06 15:01:47.195572 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:47.195510 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b44758b57-x254r_5daa15e4-e27f-4749-be92-9076fc19d6b8/console/0.log" Jul 06 15:01:47.874041 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:47.873964 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-d6v8z_7af9649f-329f-4a61-b91b-964ec516a88b/volume-data-source-validator/0.log" Jul 06 15:01:49.071775 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:49.071736 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pwplc_237f8a8c-6481-4ffa-b117-9a00b63917e4/dns/0.log" Jul 06 15:01:49.100915 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:49.100884 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pwplc_237f8a8c-6481-4ffa-b117-9a00b63917e4/kube-rbac-proxy/0.log" Jul 06 15:01:49.219116 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:49.219082 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gkrh4_2f5a6228-018c-4abe-b695-0be2d969f75f/dns-node-resolver/0.log" Jul 06 15:01:49.936420 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:49.936368 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wtlss_4ee272d2-a9a5-4bda-b04a-c0833b785412/node-ca/0.log" Jul 06 15:01:51.085105 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:51.085072 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4287d8_fb364d0c-b79d-45e1-8d73-6e1e3c723059/istio-proxy/0.log" Jul 06 15:01:51.574886 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:51.574852 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d778f859f-t8gjz_0d6d9866-81db-423a-b0ff-75a455a72619/router/0.log" Jul 06 15:01:52.329619 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:52.329586 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-546wb_5d751f46-4d3b-42b0-ae32-1215e09a5669/serve-healthcheck-canary/0.log" Jul 06 15:01:53.083027 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:53.082961 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vcw5v_abc744a8-ca28-4c7a-92e1-9d95de8b4b61/kube-rbac-proxy/0.log" Jul 06 15:01:53.113082 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:53.113046 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vcw5v_abc744a8-ca28-4c7a-92e1-9d95de8b4b61/exporter/0.log" Jul 06 15:01:53.144436 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:53.144382 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vcw5v_abc744a8-ca28-4c7a-92e1-9d95de8b4b61/extractor/0.log" Jul 06 15:01:54.005892 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:54.005859 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-25f49/perf-node-gather-daemonset-9jmjs" Jul 06 15:01:56.664869 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:56.664828 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4287d8_fb364d0c-b79d-45e1-8d73-6e1e3c723059/istio-proxy/0.log" Jul 06 15:01:56.699599 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:56.699480 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v_baa3e291-464d-47ce-bb15-b0cfd33e926f/manager/0.log" Jul 06 15:01:56.727992 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:56.727946 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ccf4f7c96-w6c8v_baa3e291-464d-47ce-bb15-b0cfd33e926f/copy-manifests/0.log" Jul 06 15:01:57.092959 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:57.092919 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d778f859f-t8gjz_0d6d9866-81db-423a-b0ff-75a455a72619/router/0.log" Jul 06 15:01:58.473684 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:58.473613 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d677d8c9-7z9vs_c8d76683-c9e9-4847-a624-2af67b808c8e/manager/0.log" Jul 06 15:01:58.507089 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:58.507039 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-bvgs7_49fc0416-87a4-4705-b184-09ceb911cfc7/openshift-lws-operator/0.log" Jul 06 15:01:58.585431 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:58.585394 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4287d8_fb364d0c-b79d-45e1-8d73-6e1e3c723059/istio-proxy/0.log" Jul 06 15:01:59.032502 ip-10-0-136-208 kubenswrapper[2582]: I0706 15:01:59.032468 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d778f859f-t8gjz_0d6d9866-81db-423a-b0ff-75a455a72619/router/0.log"